2025-12-03 19:00:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-03 19:00:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-03 19:00:05 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2025-12-03 19:00:05 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-03 19:00:05 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-03 19:00:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-03 19:00:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-03 19:00:05 [scrapy.extensions.telnet] INFO: Telnet Password: 32bb18fcf87ff537
2025-12-03 19:00:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-03 19:00:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2025-12-03T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-03 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-03 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-03 19:00:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-03 19:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-03 19:00:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-03 19:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-03 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-03 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-03 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-03 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-03 19:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-03 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-03 19:00:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-03 19:00:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-03 19:00:06 [scrapy.core.engine] INFO: Spider opened
2025-12-03 19:00:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-03 19:00:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-03 19:00:06 [scrapy-playwright] INFO: Starting download handler
2025-12-03 19:00:06 [scrapy-playwright] INFO: Starting download handler
2025-12-03 19:00:11 [scrapy-playwright] INFO: Launching browser firefox
2025-12-03 19:00:11 [scrapy-playwright] INFO: Browser firefox launched
2025-12-03 19:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-03 19:00:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-03 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-03 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-03 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css?family=Lexend> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js>
2025-12-03 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css>
2025-12-03 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js>
2025-12-03 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js>
2025-12-03 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css?family=Lexend>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://sessions.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/profileconfig> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf> (resource type: font, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/profileconfig>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/user> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/navigation> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/user>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/navigation>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/facebook.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/facebook.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/twitter.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/twitter.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/sprite2.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/sprite2.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/vehicle/all> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2> (resource type: font, referrer: https://fonts.googleapis.com/)
2025-12-03 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/vehicle/all>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-engine.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-engine.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-reg.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-v5.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-reg.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-v5.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mot.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mot.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-vat.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-vat.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0701752-17d0-4bc1-9788-9e0a68c38bc3_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0701752-17d0-4bc1-9788-9e0a68c38bc3_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/ML14HKV/2025-10-30/image/fa7311e5-4d41-41aa-b029-0963ab3751ae_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/ML14HKV/2025-10-30/image/fa7311e5-4d41-41aa-b029-0963ab3751ae_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/CE61KWA/2025-11-27/image/203b6099-6ac4-43f2-b7b4-80ac93412b6e_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/CE61KWA/2025-11-27/image/203b6099-6ac4-43f2-b7b4-80ac93412b6e_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LA69KUK/2025-12-01/image/9a45b052-eb6d-4bb4-90da-c89eb0d0cbde_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LA69KUK/2025-12-01/image/9a45b052-eb6d-4bb4-90da-c89eb0d0cbde_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/KX62SFV/2025-11-28/image/b5a69987-a15a-4c94-bb9a-c6758191faf3_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/KX62SFV/2025-11-28/image/b5a69987-a15a-4c94-bb9a-c6758191faf3_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/AU13GXL/2025-12-01/image/4a1f91af-b481-4afb-a9a6-687b5044d7f6_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/AU13GXL/2025-12-01/image/4a1f91af-b481-4afb-a9a6-687b5044d7f6_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/GDD504L/2025-11-25/image/651726ca-f29f-42f6-ab72-54ce6818ecdc_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/GDD504L/2025-11-25/image/651726ca-f29f-42f6-ab72-54ce6818ecdc_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/GF61XRR/2025-12-02/image/60aedfc9-60b8-4ac8-9ecc-4b0820145a23_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/GF61XRR/2025-12-02/image/60aedfc9-60b8-4ac8-9ecc-4b0820145a23_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SA15NBL/2025-11-17/image/f48fcd41-baff-4a72-8071-cb1b33ab5e90_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SA15NBL/2025-11-17/image/f48fcd41-baff-4a72-8071-cb1b33ab5e90_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/image-unavailable.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/image-unavailable.png>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <202 https://sessions.bugsnag.com/>
2025-12-03 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-03 19:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/vehicle-search> (referer: None) ['playwright']
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg>
2025-12-03 19:00:17 [astonbarclay.gb] INFO: Cookies from Playwright: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Wed+Dec+03+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/', 'expires': 1796324417, 'httpOnly': False, 'secure': False, 'sameSite': 'Lax'}]
2025-12-03 19:00:17 [astonbarclay.gb] INFO: Scrapy-formatted cookies: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Wed+Dec+03+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/'}]
2025-12-03 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Adesa',RowKey='cookies') HTTP/1.1" 204 0
2025-12-03 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-03 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-03 19:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/search?nonrunner=false&vehicletype=Car&agemax=9&mileagemax=320000> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117121214
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117121214: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117400496
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400496%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117400496: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117440690
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117440690: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117024353
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117024353: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117662118
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662118%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117662118: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117288542
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117288542: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117289360
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117289360: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117635092
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635092%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117635092: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117288965
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117288965: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117024058
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117024058: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117662079
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662079%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117662079: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117662383
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662383%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117662383: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117661782
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661782%27 HTTP/1.1" 200 None
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117661782: 0
2025-12-03 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116671419
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116671419: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117131404
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117131404: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117660087
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660087%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117660087: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117175645
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117175645: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117131550
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117131550: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117507998
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507998%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117507998: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117175584
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117175584: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117243071
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117243071: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117131446
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117131446: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117634437
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634437%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117634437: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 115431227
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 115431227: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117633088
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633088%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117633088: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117576849
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576849%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117576849: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116134889
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116134889: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117576600
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576600%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117576600: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116989244
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116989244: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117290737
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290737%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117290737: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116755943
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116755943%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116755943: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 114089759
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114089759%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 114089759: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117330721
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117330721: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117632563
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632563%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117632563: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117421533
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117421533: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117311708
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117311708: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117376148
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376148%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117376148: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117583759
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583759%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117583759: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117415236
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415236%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117415236: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117563502
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563502%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117563502: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117077436
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117077436: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117422977
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422977%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117422977: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117459934
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459934%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117459934: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117576078
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576078%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117576078: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117386686
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117386686%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117386686: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117584632
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584632%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117584632: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117484807
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484807%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117484807: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117542492
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542492%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117542492: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117539515
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539515%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117539515: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117494253
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117494253%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117494253: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117536984
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536984%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117536984: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117544119
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544119%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117544119: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117598923
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598923%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117598923: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117539643
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539643%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117539643: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117537448
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537448%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117537448: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117550449
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550449%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117550449: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117552007
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552007%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117552007: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117541699
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541699%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117541699: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117498338
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498338%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117498338: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117552056
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552056%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117552056: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117558544
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558544%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117558544: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117573652
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573652%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117573652: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117615483
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615483%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117615483: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117615572
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615572%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117615572: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117615464
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615464%27 HTTP/1.1" 200 None
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117615464: 0
2025-12-03 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117615130
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615130%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117615130: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117569240
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569240%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117569240: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117549984
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549984%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117549984: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117573571
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573571%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117573571: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117603221
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603221%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117603221: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117638971
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638971%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117638971: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117612919
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117612919%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117612919: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117627785
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627785%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117627785: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117625569
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625569%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117625569: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117615414
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615414%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117615414: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117581566
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581566%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117581566: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117645160
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117645160%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117645160: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117616437
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616437%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117616437: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117616597
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616597%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117616597: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117597433
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597433%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117597433: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117632895
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632895%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117632895: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117631988
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631988%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117631988: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117632412
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632412%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117632412: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117540360
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540360%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117540360: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117022539
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117022539: 2
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117023522
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117023522: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117023546
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117023546: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117481203
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117481203%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117481203: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117135963
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117135963: 2
2025-12-03 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117121221
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117121221: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117662789
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662789%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117662789: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498427
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498427: 2
2025-12-03 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117030784
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117030784: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498519
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498519%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498519: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116509919
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116509919: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117073655
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117073655: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498468
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498468: 2
2025-12-03 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117455255
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117455255: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116321191
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116321191: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117406735
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117406735: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117515973
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117515973: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117590193
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590193%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117590193: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116802225
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116802225: 2
2025-12-03 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116674717
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116674717: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117245171
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117245171: 0
2025-12-03 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116409684
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116409684: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117576471
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576471%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117576471: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116859641
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116859641: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117483520
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117483520%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117483520: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116857256
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116857256: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117576544
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117576544: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116377459
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116377459: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117215946
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117215946: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117507636
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507636%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117507636: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117545534
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545534%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117545534: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117631646
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631646%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117631646: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117605293
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605293%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117605293: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117256710
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256710%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117256710: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117605302
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605302%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117605302: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117189741
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117189741: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117539813
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539813%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117539813: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117184599
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117184599: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117207188
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117207188: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117207172
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117207172: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117002721
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117002721: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117480843
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480843%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117480843: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117357391
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117357391: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117267405
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267405%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117267405: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117452123
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117452123: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117569819
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117569819: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117425377
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117425377: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117568753
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117568753: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117599337
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599337%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117599337: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117217399
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117217399: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 114036273
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 114036273: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117079065
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117079065: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117310723
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117310723: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117452490
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117452490: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117276677
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117276677: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116994676
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116994676: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117459952
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117459952: 2
2025-12-03 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117144960
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117144960: 2
2025-12-03 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517662
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517662%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517662: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117418998
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418998%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117418998: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117190866
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190866%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117190866: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517675
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517675%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517675: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517631
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517631%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517631: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117099421
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099421%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117099421: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517620
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517620%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517620: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117584272
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584272%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117584272: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517693
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517693%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517693: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117584328
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584328%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117584328: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117492502
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492502%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117492502: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517733
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517733%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517733: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517710
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517710%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517710: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117399393
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399393%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117399393: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116930700
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116930700%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116930700: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117517747
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517747%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117517747: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116945130
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116945130%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116945130: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117584337
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584337%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117584337: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116152685
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152685%27 HTTP/1.1" 200 None
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116152685: 0
2025-12-03 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117082695
2025-12-03 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082695%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117082695: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116152721
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152721%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116152721: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117625064
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625064%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117625064: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117517722
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517722%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117517722: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 115997019
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115997019%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 115997019: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116931547
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116931547: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584319
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584319%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584319: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584261
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584261%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584261: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117048263
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117048263%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117048263: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117033189
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117033189%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117033189: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116016591
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116016591: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117457493
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457493%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117457493: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117399936
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399936%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117399936: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584308
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584308%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584308: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116496702
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116496702: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584298
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584298%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584298: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116725518
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116725518%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116725518: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554820
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554820%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554820: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554753
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554753: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554783
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554783%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554783: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554620
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554620: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117407507
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407507%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117407507: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584452
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584452%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584452: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554554
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554554%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554554: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584474
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584474%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584474: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554834
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554834%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554834: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554643
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554643%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554643: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554606
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554606: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554856
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554856%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554856: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117100098
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117100098: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554665
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554665: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554583
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554583: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116655276
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116655276%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116655276: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554799
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554799%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554799: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554544
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554544: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554715
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554715: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554737
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554737%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554737: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554866
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554866%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554866: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117554653
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554653%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117554653: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117143069
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117143069%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117143069: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117500036
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500036%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117500036: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117006204
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117006204%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117006204: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117260057
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260057%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117260057: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117138563
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117138563%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117138563: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116470730
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116470730%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116470730: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117431475
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431475%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117431475: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117505111
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505111%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117505111: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116136757
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116136757%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116136757: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117427357
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427357%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117427357: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117289497
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289497%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117289497: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117574337
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574337%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117574337: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117288373
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288373%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117288373: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117584133
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584133%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117584133: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117542530
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542530%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117542530: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117381174
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381174%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117381174: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117357513
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357513%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117357513: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117458227
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458227%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117458227: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117383402
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117383402%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117383402: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116954790
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954790%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116954790: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117406459
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406459%27 HTTP/1.1" 200 None
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117406459: 0
2025-12-03 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117493253
2025-12-03 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493253%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117493253: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116996626
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116996626%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116996626: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117157384
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117157384%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117157384: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117391120
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117391120%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117391120: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117558104
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558104%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117558104: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117363536
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363536%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117363536: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117056499
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056499%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117056499: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117536701
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536701%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117536701: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117433187
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433187%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117433187: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117362156
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117362156: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117220839
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117220839%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117220839: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116832401
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832401%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116832401: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117509080
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509080%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117509080: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117099177
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099177%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117099177: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117480129
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480129%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117480129: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117381561
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381561%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117381561: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117366645
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366645%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117366645: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117314112
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117314112%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117314112: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117363031
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363031%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117363031: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117609383
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609383%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117609383: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117584826
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584826%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117584826: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117484817
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484817%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117484817: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117509119
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509119%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117509119: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117344303
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344303%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117344303: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117429174
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429174%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117429174: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117571604
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571604%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117571604: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117574882
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574882%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117574882: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117397431
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397431%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117397431: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117440946
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440946%27 HTTP/1.1" 200 None
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117440946: 0
2025-12-03 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117274570
2025-12-03 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274570%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117274570: 1
2025-12-03 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117577591
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117577591%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117577591: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117459261
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459261%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117459261: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117364905
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364905%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117364905: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117516725
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516725%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117516725: 1
2025-12-03 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117022539?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117243233
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243233%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117243233: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117473837
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117473837%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117473837: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117101420
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101420%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117101420: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117425658
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425658%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117425658: 1
2025-12-03 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117506955
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506955%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117506955: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117514814
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514814%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117514814: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117590985
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590985%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117590985: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117708065
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708065%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117708065: 1
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117600796
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600796%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117600796: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117676352
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676352%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117676352: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117662004
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662004%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117662004: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117662061
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662061%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117662061: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117550564
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550564%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117550564: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117546383
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546383%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117546383: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117550544
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550544%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117550544: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117600118
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600118%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117600118: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117600165
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600165%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117600165: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117571526
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571526%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117571526: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117214042
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214042%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117214042: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117085617
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085617%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117085617: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117523804
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523804%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117523804: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117058987
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117058987: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117403071
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403071%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117403071: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117329064
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117329064: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117492465
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492465%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117492465: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117277530
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117277530%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117277530: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117242484
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242484%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117242484: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116833742
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116833742: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117069859
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069859%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117069859: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117140776
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140776%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117140776: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117407917
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407917%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117407917: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116280997
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116280997: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117085521
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085521%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117085521: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117209040
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117209040: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116699879
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699879%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116699879: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117369086
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117369086: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117256307
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117256307: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116772841
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116772841%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116772841: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117364404
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364404%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117364404: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117422017
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422017%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117422017: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117099256
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099256%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117099256: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116361929
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116361929%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116361929: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117178728
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178728%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117178728: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116963745
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963745%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116963745: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116666877
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116666877%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116666877: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117099210
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099210%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117099210: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116183620
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116183620: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117262801
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262801%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117262801: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117235504
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117235504%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117235504: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117424159
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424159%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117424159: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117101358
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101358%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117101358: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116941457
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116941457%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116941457: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117364152
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364152%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117364152: 0
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117679182
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679182%27 HTTP/1.1" 200 None
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117679182: 1
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117022539, 'registration': 'NG68LXL', 'account': 'SID006', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Longitude 5dr', 'mileage': 42928, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2000, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NG68LXL/2025-11-12/image/b9f4ecea-2afd-4d57-977b-26ca3a590d0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/1c902a8f-308c-4d88-97de-506e77b165d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/4837c531-5d0c-4768-8cc1-fbc1567786d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/45e4475c-f521-4366-b35c-35bf345c87c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/d0b65324-7666-4fb2-ac6e-eeecc26fcc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/43ad81f9-9f6b-4ae0-b78e-511d54d5fb21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/941d6a14-2647-4b5e-a08b-d0cde5c66799_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/f339ca05-a50f-4b01-b0c4-4338f185ade8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/c3d744a8-ca79-4165-a34f-a3d809035221_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 9K - 02/21 17K - 03/22 ??', 'remarks': "ODO SHOWS 69087 IN KM'S - VOSA DISCREPANCY, VOSA STATES, 24K, 22K, 35K, 41K - SPARE KEY IN OFFICE", 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd18ac3-6da8-478c-9b2f-85cffd32ccdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117022539, 'registration': 'NG68LXL', 'account': 'SID006', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Longitude 5dr', 'mileage': 42928, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2000, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NG68LXL/2025-11-12/image/b9f4ecea-2afd-4d57-977b-26ca3a590d0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/1c902a8f-308c-4d88-97de-506e77b165d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/4837c531-5d0c-4768-8cc1-fbc1567786d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/45e4475c-f521-4366-b35c-35bf345c87c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/d0b65324-7666-4fb2-ac6e-eeecc26fcc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/43ad81f9-9f6b-4ae0-b78e-511d54d5fb21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/941d6a14-2647-4b5e-a08b-d0cde5c66799_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/f339ca05-a50f-4b01-b0c4-4338f185ade8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/c3d744a8-ca79-4165-a34f-a3d809035221_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 9K - 02/21 17K - 03/22 ??', 'remarks': "ODO SHOWS 69087 IN KM'S - VOSA DISCREPANCY, VOSA STATES, 24K, 22K, 35K, 41K - SPARE KEY IN OFFICE", 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd18ac3-6da8-478c-9b2f-85cffd32ccdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-12-03 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with scrape type 2
2025-12-03 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with scrape type 2
2025-12-03 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6, identifier: 117022539
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117264969
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117264969%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117264969: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117308707
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117308707%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117308707: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117058008
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058008%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117058008: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117024845
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024845%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117024845: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116560193
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116560193%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116560193: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117402247
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402247%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117402247: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117402830
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402830%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117402830: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116995130
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116995130%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116995130: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116305284
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116305284%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116305284: 0
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116178889
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116178889%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116178889: 1
2025-12-03 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-03 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-03 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-12-03 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with expiration date: 2025-12-03T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '01460e64-4cab-5bd2-9fc0-c07e97dc78a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NG68LXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117022539',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK',
 'odometer': 42928,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': 'Auction Plus',
 'title': 'JEEP RENEGADE HATCHBACK 1.0 T3 GSE Longitude 5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Longitude 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Saving data for 117022539: {'auction_closing_time': 1764756000.0, 'created_time': 1763024481.81059, 'last_price_update_time': 1764788426.809444}
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117022539') HTTP/1.1" 204 0
2025-12-03 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498468?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117135963?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116987948
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116987948%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116987948: 1
2025-12-03 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498427?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116802225?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117137704
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117137704%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117137704: 1
2025-12-03 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117076326
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117076326%27 HTTP/1.1" 200 None
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117076326: 1
2025-12-03 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116295138
2025-12-03 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116295138%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116295138: 1
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 116196559
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116196559%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116196559: 1
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 116876236
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116876236%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116876236: 1
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117335606
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117335606%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117335606: 1
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117059866
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117059866%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117059866: 1
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117498468, 'registration': 'GM17XED', 'account': 'CAR001', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '1.4 TFSI S Line 5dr', 'mileage': 101160, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2122, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-07-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GM17XED/2025-11-26/image/e42f3f23-344a-47d2-bca8-b4921d836a1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/c628983e-183f-4a95-984e-063daa6dd39d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/6044d930-93f5-44a4-a876-328ef33b9190_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/42bcd19b-bdea-4e78-a7b8-0729d2368ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/1271f48a-ccf3-47a1-9a49-0919b2d3a3fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/0812ca6c-17f0-4965-83d1-5d3b4eca6381_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/4af7f511-9722-4731-a627-7f663001110b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/b8c393b0-e9a7-408f-b9f2-98daeb689647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/99503677-4a14-4a18-9d61-d92eef58714e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/36bdd5cc-5efe-426f-8f51-78076b3044e1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/18-15K 06/19-26K', 'remarks': 'SD CARD IN OFFICE, VOSA STATES 64K 76K 86K 96K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01a8a745-47d1-479c-a13f-d6c6e740a7b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117498468, 'registration': 'GM17XED', 'account': 'CAR001', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '1.4 TFSI S Line 5dr', 'mileage': 101160, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2122, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-07-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GM17XED/2025-11-26/image/e42f3f23-344a-47d2-bca8-b4921d836a1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/c628983e-183f-4a95-984e-063daa6dd39d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/6044d930-93f5-44a4-a876-328ef33b9190_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/42bcd19b-bdea-4e78-a7b8-0729d2368ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/1271f48a-ccf3-47a1-9a49-0919b2d3a3fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/0812ca6c-17f0-4965-83d1-5d3b4eca6381_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/4af7f511-9722-4731-a627-7f663001110b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/b8c393b0-e9a7-408f-b9f2-98daeb689647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/99503677-4a14-4a18-9d61-d92eef58714e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/36bdd5cc-5efe-426f-8f51-78076b3044e1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/18-15K 06/19-26K', 'remarks': 'SD CARD IN OFFICE, VOSA STATES 64K 76K 86K 96K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01a8a745-47d1-479c-a13f-d6c6e740a7b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ffa2e0-3016-58b5-bb72-774983a004f0 with identifier: 117498468
2025-12-03 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ffa2e0-3016-58b5-bb72-774983a004f0 with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ffa2e0-3016-58b5-bb72-774983a004f0 with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b6ffa2e0-3016-58b5-bb72-774983a004f0, identifier: 117498468
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117135963, 'registration': 'LX66LNR', 'account': 'SID006', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '1.0 TFSI Sport 5dr', 'mileage': 84576, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2011, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-03', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66LNR/2025-11-25/image/b58b5dd2-396f-4cb7-9ee8-b95e4927ec53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/7d60b44f-9967-419f-9f9b-747151379cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/342067ed-2e8e-4478-a326-e02279e5210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/661fc492-177e-4936-ac7f-04cadff40636_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/f3b2ffc4-21f0-408b-b879-3f4ae5804950_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/e3c52318-0382-443e-8ad2-f39cd51fb4aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/0594d9dd-5231-4c0c-afb0-314cfd8800de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/deaa8a75-ed42-431f-b09f-4b7d72a416b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a13df5df-8b41-4c53-81db-a0a2c0ee03dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/84c6abf6-02df-4c12-bb7c-035e917658b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a5135f13-e012-4237-ac2c-8b41733d5e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/4b87a4e9-2ee6-49d4-9d2f-024ebc038068_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 ONLY -VOSA STATES 45K, 55K, 61K, 82K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd44ffd5-2a16-4a54-84fd-e8dd8d7b9bfb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117135963, 'registration': 'LX66LNR', 'account': 'SID006', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '1.0 TFSI Sport 5dr', 'mileage': 84576, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2011, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-03', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66LNR/2025-11-25/image/b58b5dd2-396f-4cb7-9ee8-b95e4927ec53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/7d60b44f-9967-419f-9f9b-747151379cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/342067ed-2e8e-4478-a326-e02279e5210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/661fc492-177e-4936-ac7f-04cadff40636_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/f3b2ffc4-21f0-408b-b879-3f4ae5804950_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/e3c52318-0382-443e-8ad2-f39cd51fb4aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/0594d9dd-5231-4c0c-afb0-314cfd8800de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/deaa8a75-ed42-431f-b09f-4b7d72a416b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a13df5df-8b41-4c53-81db-a0a2c0ee03dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/84c6abf6-02df-4c12-bb7c-035e917658b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a5135f13-e012-4237-ac2c-8b41733d5e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/4b87a4e9-2ee6-49d4-9d2f-024ebc038068_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 ONLY -VOSA STATES 45K, 55K, 61K, 82K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd44ffd5-2a16-4a54-84fd-e8dd8d7b9bfb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-12-03 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e186c8-37e8-5509-8502-2d44f8e4150f with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e186c8-37e8-5509-8502-2d44f8e4150f with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 45e186c8-37e8-5509-8502-2d44f8e4150f, identifier: 117135963
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 116401849
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116401849%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116401849: 1
2025-12-03 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b6ffa2e0-3016-58b5-bb72-774983a004f0 with identifier: 117498468
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-03 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b6ffa2e0-3016-58b5-bb72-774983a004f0 with identifier: 117498468
2025-12-03 19:00:27 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: b6ffa2e0-3016-58b5-bb72-774983a004f0 with expiration date: 2025-12-03T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b6ffa2e0-3016-58b5-bb72-774983a004f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GM17XED',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498468',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 101160,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-06',
 'seller_name': 'CarGiant',
 'title': 'AUDI Q2 ESTATE 1.4 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.4 TFSI S Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Saving data for 117498468: {'auction_closing_time': 1764756000.0, 'created_time': 1764097431.839747, 'last_price_update_time': 1764788427.480978}
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498468') HTTP/1.1" 204 0
2025-12-03 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-03 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-12-03 19:00:27 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 45e186c8-37e8-5509-8502-2d44f8e4150f with expiration date: 2025-12-03T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '45e186c8-37e8-5509-8502-2d44f8e4150f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX66LNR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117135963',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 84576,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-03',
 'seller_name': 'Auction Plus',
 'title': 'AUDI A3 SPORTBACK 1.0 TFSI Sport 5dr',
 'transmission': 'manual',
 'trim': '1.0 TFSI Sport 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Saving data for 117135963: {'auction_closing_time': 1764756000.0, 'created_time': 1763060478.532667, 'last_price_update_time': 1764788427.648931}
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117135963') HTTP/1.1" 204 0
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117498427, 'registration': 'KP66OTZ', 'account': 'CAR001', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE 4dr Step Auto', 'mileage': 78302, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2111, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-10', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/431e4a43-ed8b-4338-8c4e-e89b7628f8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/cff74451-36a2-4c96-a000-930264c2d943_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/118fbde7-40a7-46c8-b876-3597a3198386_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8a68b093-06db-4acb-ad1d-a52741b25f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8dca468f-dc48-4e1e-a25b-bc8bfde7be96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/73b46e2e-3448-4bed-b428-519d31bb2f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/01410eb1-f124-4a68-86ef-73a2bbfcb4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/7e2e0ac5-75c0-483c-9d5c-0bb6b55c24f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/b97bfd61-d442-4d4a-8b36-99e54cd974ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8d900a60-0bc0-4f5f-a965-f71fee3cdbad_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/18-15K 03/19-18K 09/19-20K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 42K 55K 71K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8c8a8d5a-3de3-469f-af99-4786d5c80fb3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117498427, 'registration': 'KP66OTZ', 'account': 'CAR001', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE 4dr Step Auto', 'mileage': 78302, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2111, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-10', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/431e4a43-ed8b-4338-8c4e-e89b7628f8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/cff74451-36a2-4c96-a000-930264c2d943_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/118fbde7-40a7-46c8-b876-3597a3198386_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8a68b093-06db-4acb-ad1d-a52741b25f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8dca468f-dc48-4e1e-a25b-bc8bfde7be96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/73b46e2e-3448-4bed-b428-519d31bb2f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/01410eb1-f124-4a68-86ef-73a2bbfcb4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/7e2e0ac5-75c0-483c-9d5c-0bb6b55c24f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/b97bfd61-d442-4d4a-8b36-99e54cd974ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8d900a60-0bc0-4f5f-a965-f71fee3cdbad_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/18-15K 03/19-18K 09/19-20K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 42K 55K 71K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8c8a8d5a-3de3-469f-af99-4786d5c80fb3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427
2025-12-03 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3973878e-6dd9-5a78-95a8-f0cc5493e34f with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3973878e-6dd9-5a78-95a8-f0cc5493e34f with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3973878e-6dd9-5a78-95a8-f0cc5493e34f, identifier: 117498427
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116802225, 'registration': 'ET23VZJ', 'account': 'GAT019', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Active 5dr', 'mileage': 28479, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2225, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-14', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/774638dc-15ce-4883-b020-80403c9586f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/623b0aa6-cb06-4571-9611-5153860db8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/0b080a7f-9969-4d50-8c03-13a1d465eff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/58d00794-e068-41a5-a8ab-4523c13084db_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/575acd9d-e147-4c91-9922-cb2c07a6184e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/2e6e9245-aee7-4cc8-a6d4-7014248ea3bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/ea15b20f-e309-4ec2-be3d-f4ddb2698fc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/c0d457e3-e09b-4c17-85f0-cbbdfb78bf5c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 IN OFFICE - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc9daa0e-8933-40f5-a27e-a1d093be26f3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116802225, 'registration': 'ET23VZJ', 'account': 'GAT019', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Active 5dr', 'mileage': 28479, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2225, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-14', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/774638dc-15ce-4883-b020-80403c9586f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/623b0aa6-cb06-4571-9611-5153860db8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/0b080a7f-9969-4d50-8c03-13a1d465eff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/58d00794-e068-41a5-a8ab-4523c13084db_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/575acd9d-e147-4c91-9922-cb2c07a6184e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/2e6e9245-aee7-4cc8-a6d4-7014248ea3bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/ea15b20f-e309-4ec2-be3d-f4ddb2698fc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/c0d457e3-e09b-4c17-85f0-cbbdfb78bf5c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 IN OFFICE - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc9daa0e-8933-40f5-a27e-a1d093be26f3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225
2025-12-03 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with scrape type 2
2025-12-03 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0, identifier: 116802225
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117069920
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069920%27 HTTP/1.1" 200 None
2025-12-03 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117069920: 1
2025-12-03 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117459952?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427
2025-12-03 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-03 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FPlugin+Electric+Hybrid HTTP/1.1" 200 None
2025-12-03 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427
2025-12-03 19:00:28 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with expiration date: 2025-12-03T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '3973878e-6dd9-5a78-95a8-f0cc5493e34f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KP66OTZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498427',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 78302,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': 'CarGiant',
 'title': 'BMW 3 SERIES SALOON 330e SE 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e SE 4dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Saving data for 117498427: {'auction_closing_time': 1764756000.0, 'created_time': 1764097433.168573, 'last_price_update_time': 1764788428.273279}
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498427') HTTP/1.1" 204 0
2025-12-03 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid+Electric HTTP/1.1" 200 None
2025-12-03 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225
2025-12-03 19:00:28 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with expiration date: 2025-12-03T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET23VZJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116802225',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 28479,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-14',
 'seller_name': 'Gates Group',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Active 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Active 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Saving data for 116802225: {'auction_closing_time': 1764756000.0, 'created_time': 1761814846.001401, 'last_price_update_time': 1764788428.472812}
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116802225') HTTP/1.1" 204 0
2025-12-03 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 116963987
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963987%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Scrape type for 116963987: 1
2025-12-03 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117144960?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 116988272
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988272%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Scrape type for 116988272: 1
2025-12-03 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117459952, 'registration': 'MV67YWC', 'account': 'HEN022', 'make': 'SKODA', 'model': 'FABIA HATCHBACK', 'derivative': '1.0 TSI SE L 5dr', 'mileage': 62058, 'mileageWarranty': True, 'type': 'car', 'saleId': 18004, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-03T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV67YWC/2025-11-26/image/58a0cbde-2f7d-4907-965c-84084244c881_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/40120ae0-4ebd-4dc1-97da-59de14715c40_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95639384-2ef3-473b-abe6-eb71385f355f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/a5cc8a23-c1bb-4416-aff2-61b402fc39e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/cfd3c44b-9377-41bc-9927-0a2c29fe9fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95bdb120-e97f-4357-8f04-ce75a6cc2ed9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/88b4450a-8db8-4bcc-aaa0-e201d98485f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/77ce2598-ef76-4576-aebd-994728cd94cc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 20K 27K 37K 45K 53K 59K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1891536a-4fbb-422e-a0ec-5e46e7718cd7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117459952, 'registration': 'MV67YWC', 'account': 'HEN022', 'make': 'SKODA', 'model': 'FABIA HATCHBACK', 'derivative': '1.0 TSI SE L 5dr', 'mileage': 62058, 'mileageWarranty': True, 'type': 'car', 'saleId': 18004, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-03T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV67YWC/2025-11-26/image/58a0cbde-2f7d-4907-965c-84084244c881_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/40120ae0-4ebd-4dc1-97da-59de14715c40_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95639384-2ef3-473b-abe6-eb71385f355f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/a5cc8a23-c1bb-4416-aff2-61b402fc39e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/cfd3c44b-9377-41bc-9927-0a2c29fe9fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95bdb120-e97f-4357-8f04-ce75a6cc2ed9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/88b4450a-8db8-4bcc-aaa0-e201d98485f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/77ce2598-ef76-4576-aebd-994728cd94cc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 20K 27K 37K 45K 53K 59K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1891536a-4fbb-422e-a0ec-5e46e7718cd7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952
2025-12-03 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with scrape type 2
2025-12-03 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with scrape type 2
2025-12-03 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b, identifier: 117459952
2025-12-03 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952
2025-12-03 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952
2025-12-03 19:00:28 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with expiration date: 2025-12-03T12:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV67YWC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117459952',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'FABIA HATCHBACK',
 'odometer': 62058,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-01',
 'seller_name': 'Car360',
 'title': 'SKODA FABIA HATCHBACK 1.0 TSI SE L 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI SE L 5dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Saving data for 117459952: {'auction_closing_time': 1764763200.0, 'created_time': 1764184101.826289, 'last_price_update_time': 1764788428.663148}
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117459952') HTTP/1.1" 204 0
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117195848
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195848%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117195848: 1
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117076340
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117076340%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117076340: 1
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117144960, 'registration': 'WR67AOM', 'account': 'HEN022', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 57509, 'mileageWarranty': True, 'type': 'car', 'saleId': 18004, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-03T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR67AOM/2025-11-14/image/07d2e941-4745-4c1d-9bf8-98e2188bbf15_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/af3fc004-54f9-4bcb-a7d5-0bb81458576a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/33aab69b-13e7-404f-a8d8-5b5bc5ed2255_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/86f5550c-a655-48dc-9b47-6ba99a8e62cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/cff63b2d-8104-4cf7-aef4-c8825206db90_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/3a0b1fc0-d3af-42b0-a23d-ca6cd74eab8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/5174e5c4-0fe5-4055-a9a9-ba97b45b63f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/006b2a73-48aa-4f2f-889d-b1eebb23590b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18-10K, 08/19-20K, 12/20-29K, 10/21-36K, 10/22-44K, 10/23-47K, 10/24-51K, 10/25-57K', 'remarks': 'SPARE KEY, VOSA STATES 28K 36K 44K 47K 51K 57K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/67f72cdd-105e-46e2-90e2-36ed4ce04ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117144960, 'registration': 'WR67AOM', 'account': 'HEN022', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 57509, 'mileageWarranty': True, 'type': 'car', 'saleId': 18004, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-03T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2017-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR67AOM/2025-11-14/image/07d2e941-4745-4c1d-9bf8-98e2188bbf15_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/af3fc004-54f9-4bcb-a7d5-0bb81458576a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/33aab69b-13e7-404f-a8d8-5b5bc5ed2255_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/86f5550c-a655-48dc-9b47-6ba99a8e62cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/cff63b2d-8104-4cf7-aef4-c8825206db90_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/3a0b1fc0-d3af-42b0-a23d-ca6cd74eab8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/5174e5c4-0fe5-4055-a9a9-ba97b45b63f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/006b2a73-48aa-4f2f-889d-b1eebb23590b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18-10K, 08/19-20K, 12/20-29K, 10/21-36K, 10/22-44K, 10/23-47K, 10/24-51K, 10/25-57K', 'remarks': 'SPARE KEY, VOSA STATES 28K 36K 44K 47K 51K 57K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/67f72cdd-105e-46e2-90e2-36ed4ce04ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960
2025-12-03 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec14c2d4-230a-52da-bb7d-a917bffc5c97 with scrape type 2
2025-12-03 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec14c2d4-230a-52da-bb7d-a917bffc5c97 with scrape type 2
2025-12-03 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec14c2d4-230a-52da-bb7d-a917bffc5c97, identifier: 117144960
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117516725, 'registration': 'DV72KZL', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '160kW Ultimate 73 kWh 5dr Auto', 'mileage': 33629, 'mileageWarranty': False, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 102, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/24-17K 05/25-27K', 'remarks': 'VOSA STATES 38K SPARE KEY MILEAGE DISCREPANCY ON VOSA', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3272d2d0-5e89-4931-b54a-e9cbda10aabf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117516725, 'registration': 'DV72KZL', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '160kW Ultimate 73 kWh 5dr Auto', 'mileage': 33629, 'mileageWarranty': False, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 102, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/24-17K 05/25-27K', 'remarks': 'VOSA STATES 38K SPARE KEY MILEAGE DISCREPANCY ON VOSA', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3272d2d0-5e89-4931-b54a-e9cbda10aabf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55c7b69-73dd-55bd-b72b-a672b0b4c576 with identifier: 117516725
2025-12-03 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55c7b69-73dd-55bd-b72b-a672b0b4c576 with scrape type 1
2025-12-03 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117195495
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195495%27 HTTP/1.1" 200 None
2025-12-03 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117195495: 1
2025-12-03 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960
2025-12-03 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960
2025-12-03 19:00:29 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with expiration date: 2025-12-03T12:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ec14c2d4-230a-52da-bb7d-a917bffc5c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WR67AOM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117144960',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 57509,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Car360',
 'title': 'FIAT 500 HATCHBACK 1.2 Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Saving data for 117144960: {'auction_closing_time': 1764763200.0, 'created_time': 1763147190.858059, 'last_price_update_time': 1764788429.139746}
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117144960') HTTP/1.1" 204 0
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117195887
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195887%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117195887: 1
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Fc68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116178889?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 116485815
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116485815%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 116485815: 1
2025-12-03 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Ffa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117195932
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195932%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117195932: 1
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117446295
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446295%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117446295: 0
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117446284
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446284%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117446284: 0
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117605321
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605321%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117605321: 0
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117121049
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121049%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117121049: 0
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117433885
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117433885: 2
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Fa4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117457472
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457472%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117457472: 2
2025-12-03 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Ffcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117425658, 'registration': 'AJ22KKR', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 23477, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 106, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Electric', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/d28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/a04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/ff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/b3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 19K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0ac2111-d5f4-4fd2-9cad-535cff63c7be.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117425658, 'registration': 'AJ22KKR', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 23477, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 106, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Electric', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/d28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/a04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/ff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/b3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 19K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0ac2111-d5f4-4fd2-9cad-535cff63c7be.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d46ec03-77a7-5e80-a555-d91c9137ef7b with identifier: 117425658
2025-12-03 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b with scrape type 1
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116178889, 'registration': 'BD73LXK', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta [Glass Roof] 5dr Auto', 'mileage': 13082, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 260, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD73LXK/2025-10-08/image/8d4cfd4c-bc5a-404e-8f86-9d194742a404_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/83b182a3-7670-4e92-b50a-f1882037284a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/b9ec4eb7-59c3-48d6-a5e3-59131ef6efaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/ed9772b5-3d4d-4739-87c7-2e56ef30db69_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/748f50d3-571a-492e-b39a-57c24fbffd1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/baa38538-385e-479d-9f2d-c95c64f3dada_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/4406fb20-f794-4b2d-a235-76d5101df19a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/f6a483f1-2007-4e94-bef8-76bdd122ea49_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a1cff83-d9eb-4d83-96d3-0f94866230f0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116178889, 'registration': 'BD73LXK', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta [Glass Roof] 5dr Auto', 'mileage': 13082, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 260, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD73LXK/2025-10-08/image/8d4cfd4c-bc5a-404e-8f86-9d194742a404_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/83b182a3-7670-4e92-b50a-f1882037284a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/b9ec4eb7-59c3-48d6-a5e3-59131ef6efaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/ed9772b5-3d4d-4739-87c7-2e56ef30db69_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/748f50d3-571a-492e-b39a-57c24fbffd1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/baa38538-385e-479d-9f2d-c95c64f3dada_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/4406fb20-f794-4b2d-a235-76d5101df19a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/f6a483f1-2007-4e94-bef8-76bdd122ea49_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a1cff83-d9eb-4d83-96d3-0f94866230f0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7 with identifier: 116178889
2025-12-03 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7 with scrape type 1
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252F8d4cfd4c-bc5a-404e-8f86-9d194742a404_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/8d4cfd4c-bc5a-404e-8f86-9d194742a404_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252F83b182a3-7670-4e92-b50a-f1882037284a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/83b182a3-7670-4e92-b50a-f1882037284a_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252Fb9ec4eb7-59c3-48d6-a5e3-59131ef6efaf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/b9ec4eb7-59c3-48d6-a5e3-59131ef6efaf_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252Fed9772b5-3d4d-4739-87c7-2e56ef30db69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/ed9772b5-3d4d-4739-87c7-2e56ef30db69_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252F748f50d3-571a-492e-b39a-57c24fbffd1b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/748f50d3-571a-492e-b39a-57c24fbffd1b_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252Fbaa38538-385e-479d-9f2d-c95c64f3dada_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/baa38538-385e-479d-9f2d-c95c64f3dada_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252F4406fb20-f794-4b2d-a235-76d5101df19a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/4406fb20-f794-4b2d-a235-76d5101df19a_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73LXK%252F2025-10-08%252Fimage%252Ff6a483f1-2007-4e94-bef8-76bdd122ea49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73LXK/2025-10-08/image/f6a483f1-2007-4e94-bef8-76bdd122ea49_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7, identifier: 116178889
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117418653
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418653%27 HTTP/1.1" 200 None
2025-12-03 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117418653: 2
2025-12-03 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7 with identifier: 116178889
2025-12-03 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7 with identifier: 116178889
2025-12-03 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7 with identifier: 116178889 to the API
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116178889?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': 'e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BD73LXK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116178889',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 13082,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BD73LXK/2025-10-08/image/8d4cfd4c-bc5a-404e-8f86-9d194742a404_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/83b182a3-7670-4e92-b50a-f1882037284a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/b9ec4eb7-59c3-48d6-a5e3-59131ef6efaf_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/ed9772b5-3d4d-4739-87c7-2e56ef30db69_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/748f50d3-571a-492e-b39a-57c24fbffd1b_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/baa38538-385e-479d-9f2d-c95c64f3dada_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/4406fb20-f794-4b2d-a235-76d5101df19a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/f6a483f1-2007-4e94-bef8-76bdd122ea49_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36178,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/8d4cfd4c-bc5a-404e-8f86-9d194742a404_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36388,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/83b182a3-7670-4e92-b50a-f1882037284a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36660,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/b9ec4eb7-59c3-48d6-a5e3-59131ef6efaf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35262,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/ed9772b5-3d4d-4739-87c7-2e56ef30db69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40367,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/748f50d3-571a-492e-b39a-57c24fbffd1b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65180,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/baa38538-385e-479d-9f2d-c95c64f3dada_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58932,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/4406fb20-f794-4b2d-a235-76d5101df19a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7/e530f6f8-9cf8-5a25-a59a-91fec8e8dbc7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57091,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73LXK/2025-10-08/image/f6a483f1-2007-4e94-bef8-76bdd122ea49_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power N-Connecta [Glass Roof] 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power N-Connecta [Glass Roof] 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116178889%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Saving data for 116178889: {'created_time': 1764788430.131233, 'last_price_update_time': 1764788430.131243, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116178889') HTTP/1.1" 204 0
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117442908
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442908%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117442908: 2
2025-12-03 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117076326?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117137704?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117708065, 'registration': 'PX66YGY', 'account': 'TR', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 86224, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-04T10:00Z', 'lot': 116, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-12-07', 'fuel': 'Petrol', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PX66YGY/2025-12-03/image/fe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/c697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/b92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/d576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/17-13K, 08/18-26K, 06/20-38K, 05/22-52K, 07/24-70K,', 'remarks': 'vosa @ 40k 46k 52k 59k 67k 78k', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/991a8c1c-903a-46a9-9f6b-4b980ea2ff1f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117708065, 'registration': 'PX66YGY', 'account': 'TR', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 86224, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-04T10:00Z', 'lot': 116, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-12-07', 'fuel': 'Petrol', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PX66YGY/2025-12-03/image/fe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/c697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/b92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/d576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/17-13K, 08/18-26K, 06/20-38K, 05/22-52K, 07/24-70K,', 'remarks': 'vosa @ 40k 46k 52k 59k 67k 78k', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/991a8c1c-903a-46a9-9f6b-4b980ea2ff1f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5badee97-f25c-55a4-bd93-27232c1c81ef with identifier: 117708065
2025-12-03 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5badee97-f25c-55a4-bd93-27232c1c81ef with scrape type 1
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Ffe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/fe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117679182, 'registration': 'DA67AVK', 'account': 'TR', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 eD4 SE 5dr 2WD', 'mileage': 119386, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-04T10:00Z', 'lot': 230, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-11-14', 'fuel': 'Diesel', 'motExpiry': '2026-09-05', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DA67AVK/2025-12-02/image/38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/acd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/e79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 01/19- 15k, 01/20- 30k, 08/20- 36k, 09/21- 54k, 06/23- 85k', 'remarks': 'vosa - 36k, 53k, 69k, 88k, 104k, 119k', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a8f87a7-00ec-4519-bbd8-15fe6785196d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117679182, 'registration': 'DA67AVK', 'account': 'TR', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 eD4 SE 5dr 2WD', 'mileage': 119386, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-04T10:00Z', 'lot': 230, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-11-14', 'fuel': 'Diesel', 'motExpiry': '2026-09-05', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DA67AVK/2025-12-02/image/38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/acd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/e79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 01/19- 15k, 01/20- 30k, 08/20- 36k, 09/21- 54k, 06/23- 85k', 'remarks': 'vosa - 36k, 53k, 69k, 88k, 104k, 119k', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a8f87a7-00ec-4519-bbd8-15fe6785196d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3071479-531b-5073-80a0-213bea052820 with identifier: 117679182
2025-12-03 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3071479-531b-5073-80a0-213bea052820 with scrape type 1
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fd28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/d28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117377340
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117377340%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117377340: 1
2025-12-03 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fa75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252Facd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/acd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fa04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/a04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116987948?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117222053
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117222053%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117222053: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117103708
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103708%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117103708: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117420890
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420890%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117420890: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117451511
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451511%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117451511: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117442253
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442253%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117442253: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117420349
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420349%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117420349: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117548617
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548617%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117548617: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117579914
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579914%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117579914: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117400056
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400056%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117400056: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116827121
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116827121%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116827121: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116914684
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116914684: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116831775
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831775%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116831775: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116699888
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116699888: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116699739
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116699739: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116318543
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116318543: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117339782
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339782%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117339782: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117547841
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547841%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117547841: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117547879
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547879%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117547879: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117508313
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508313%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117508313: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117457056
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457056%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117457056: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117447701
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447701%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117447701: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117597727
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597727%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117597727: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117274456
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117274456: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117410407
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117410407%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117410407: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 115510423
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115510423%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 115510423: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117240084
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240084%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117240084: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116997115
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997115%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116997115: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117509758
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509758%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117509758: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117565754
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565754%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117565754: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116859206
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859206%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116859206: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117549752
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549752%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117549752: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117544110
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544110%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117544110: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117575865
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117575865%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117575865: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117427071
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427071%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117427071: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117590494
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590494%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117590494: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117103769
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103769%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117103769: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117491214
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117491214: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117508301
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508301%27 HTTP/1.1" 200 None
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117508301: 0
2025-12-03 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117103670
2025-12-03 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103670%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117103670: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117274004
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274004%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117274004: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117100813
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100813%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117100813: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117508326
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508326%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117508326: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117446881
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446881%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117446881: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117215446
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117215446: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117180618
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180618%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117180618: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117549690
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549690%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117549690: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117524612
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117524612%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117524612: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117133968
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117133968%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117133968: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117188811
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188811%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117188811: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117561425
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561425%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117561425: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 116637669
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116637669%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 116637669: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117311401
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117311401: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117056567
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056567%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117056567: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117417496
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117417496%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117417496: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117120537
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120537%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117120537: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117029988
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117029988%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117029988: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117019833
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019833%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117019833: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117344624
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344624%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117344624: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117549728
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549728%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117549728: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 116339169
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 116339169: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117367108
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117367108%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117367108: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117372665
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372665%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117372665: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117180212
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180212%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117180212: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117446714
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446714%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117446714: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117581526
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581526%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117581526: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 116833978
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833978%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 116833978: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117215585
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215585%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117215585: 0
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117415492
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415492%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117415492: 2
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fa47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117076326, 'registration': 'BG72TVN', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Tekna 5dr Xtronic', 'mileage': 16641, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 263, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BG72TVN/2025-11-18/image/8a9948bb-2590-40a3-98fd-02161f88092d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/639e9913-d1e5-4a65-acd9-f19225cd3607_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/dec64504-c215-4111-9432-6b05b58a4128_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/6fa4a312-4669-4d1a-b7d0-707571c8dbbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/4c0b846e-2acc-43ab-a1c8-05d16a542ed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/c1e47969-12ff-45fb-98a2-bf91de99d9cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/fc27f0b3-e00d-42de-a38c-270091339ce0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/f98ca687-1ce9-4a10-b3e3-931c7710ac00_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/25 16K', 'remarks': 'VOSA STATES 16K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16962675-a666-40d5-8ce0-930c088723a5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117076326, 'registration': 'BG72TVN', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Tekna 5dr Xtronic', 'mileage': 16641, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 263, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BG72TVN/2025-11-18/image/8a9948bb-2590-40a3-98fd-02161f88092d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/639e9913-d1e5-4a65-acd9-f19225cd3607_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/dec64504-c215-4111-9432-6b05b58a4128_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/6fa4a312-4669-4d1a-b7d0-707571c8dbbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/4c0b846e-2acc-43ab-a1c8-05d16a542ed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/c1e47969-12ff-45fb-98a2-bf91de99d9cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/fc27f0b3-e00d-42de-a38c-270091339ce0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/f98ca687-1ce9-4a10-b3e3-931c7710ac00_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/25 16K', 'remarks': 'VOSA STATES 16K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16962675-a666-40d5-8ce0-930c088723a5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3190de30-27b7-550f-bb67-194c05e7bf77 with identifier: 117076326
2025-12-03 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3190de30-27b7-550f-bb67-194c05e7bf77 with scrape type 1
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3190de30-27b7-550f-bb67-194c05e7bf77
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252F8a9948bb-2590-40a3-98fd-02161f88092d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/8a9948bb-2590-40a3-98fd-02161f88092d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252F639e9913-d1e5-4a65-acd9-f19225cd3607_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/639e9913-d1e5-4a65-acd9-f19225cd3607_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252Fdec64504-c215-4111-9432-6b05b58a4128_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/dec64504-c215-4111-9432-6b05b58a4128_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252F6fa4a312-4669-4d1a-b7d0-707571c8dbbc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/6fa4a312-4669-4d1a-b7d0-707571c8dbbc_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252F4c0b846e-2acc-43ab-a1c8-05d16a542ed6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/4c0b846e-2acc-43ab-a1c8-05d16a542ed6_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252Fc1e47969-12ff-45fb-98a2-bf91de99d9cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/c1e47969-12ff-45fb-98a2-bf91de99d9cf_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252Ffc27f0b3-e00d-42de-a38c-270091339ce0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/fc27f0b3-e00d-42de-a38c-270091339ce0_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72TVN%252F2025-11-18%252Fimage%252Ff98ca687-1ce9-4a10-b3e3-931c7710ac00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72TVN/2025-11-18/image/f98ca687-1ce9-4a10-b3e3-931c7710ac00_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3190de30-27b7-550f-bb67-194c05e7bf77, identifier: 117076326
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117137704, 'registration': 'BD72FWG', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Prem [Glass Rf] 5dr Xtron', 'mileage': 34813, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 262, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD72FWG/2025-11-17/image/e4f2be7f-9f9d-449e-ae25-b7e63c05e8f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/64614c15-5add-4b7f-87b4-1fe96fb64dcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/083bccc7-9594-409b-986c-1a4212ea33f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/217f7418-d922-44e5-94be-064d62aad894_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/9a6d3bef-cc64-43a6-b374-03a6c6662756_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/c14abe0d-f637-4b7a-babb-7d9f8f485d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/921c0246-e97f-4b1c-9c77-752584413658_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/5dc37943-a215-4202-b26f-8c098947ba62_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/23-13K 09/24-27K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/abcf99be-cac4-430f-b641-1c034e51b7b2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117137704, 'registration': 'BD72FWG', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Prem [Glass Rf] 5dr Xtron', 'mileage': 34813, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 262, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD72FWG/2025-11-17/image/e4f2be7f-9f9d-449e-ae25-b7e63c05e8f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/64614c15-5add-4b7f-87b4-1fe96fb64dcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/083bccc7-9594-409b-986c-1a4212ea33f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/217f7418-d922-44e5-94be-064d62aad894_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/9a6d3bef-cc64-43a6-b374-03a6c6662756_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/c14abe0d-f637-4b7a-babb-7d9f8f485d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/921c0246-e97f-4b1c-9c77-752584413658_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/5dc37943-a215-4202-b26f-8c098947ba62_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/23-13K 09/24-27K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/abcf99be-cac4-430f-b641-1c034e51b7b2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3de608-a476-56b1-bed3-f5056dcc525e with identifier: 117137704
2025-12-03 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3de608-a476-56b1-bed3-f5056dcc525e with scrape type 1
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cf3de608-a476-56b1-bed3-f5056dcc525e
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252Fe4f2be7f-9f9d-449e-ae25-b7e63c05e8f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/e4f2be7f-9f9d-449e-ae25-b7e63c05e8f1_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252F64614c15-5add-4b7f-87b4-1fe96fb64dcb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/64614c15-5add-4b7f-87b4-1fe96fb64dcb_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252F083bccc7-9594-409b-986c-1a4212ea33f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/083bccc7-9594-409b-986c-1a4212ea33f4_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252F217f7418-d922-44e5-94be-064d62aad894_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/217f7418-d922-44e5-94be-064d62aad894_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252F9a6d3bef-cc64-43a6-b374-03a6c6662756_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/9a6d3bef-cc64-43a6-b374-03a6c6662756_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252Fc14abe0d-f637-4b7a-babb-7d9f8f485d5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/c14abe0d-f637-4b7a-babb-7d9f8f485d5c_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252F921c0246-e97f-4b1c-9c77-752584413658_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/921c0246-e97f-4b1c-9c77-752584413658_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD72FWG%252F2025-11-17%252Fimage%252F5dc37943-a215-4202-b26f-8c098947ba62_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD72FWG/2025-11-17/image/5dc37943-a215-4202-b26f-8c098947ba62_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cf3de608-a476-56b1-bed3-f5056dcc525e, identifier: 117137704
2025-12-03 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117441346
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441346%27 HTTP/1.1" 200 None
2025-12-03 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117441346: 2
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3190de30-27b7-550f-bb67-194c05e7bf77 with identifier: 117076326
2025-12-03 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3190de30-27b7-550f-bb67-194c05e7bf77 with identifier: 117076326
2025-12-03 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3190de30-27b7-550f-bb67-194c05e7bf77 with identifier: 117076326 to the API
2025-12-03 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117076326?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3190de30-27b7-550f-bb67-194c05e7bf77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BG72TVN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117076326',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 16641,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BG72TVN/2025-11-18/image/8a9948bb-2590-40a3-98fd-02161f88092d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/639e9913-d1e5-4a65-acd9-f19225cd3607_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/dec64504-c215-4111-9432-6b05b58a4128_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/6fa4a312-4669-4d1a-b7d0-707571c8dbbc_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/4c0b846e-2acc-43ab-a1c8-05d16a542ed6_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/c1e47969-12ff-45fb-98a2-bf91de99d9cf_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/fc27f0b3-e00d-42de-a38c-270091339ce0_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/f98ca687-1ce9-4a10-b3e3-931c7710ac00_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34185,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/8a9948bb-2590-40a3-98fd-02161f88092d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33260,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/639e9913-d1e5-4a65-acd9-f19225cd3607_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32684,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/dec64504-c215-4111-9432-6b05b58a4128_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31498,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/6fa4a312-4669-4d1a-b7d0-707571c8dbbc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66441,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/4c0b846e-2acc-43ab-a1c8-05d16a542ed6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73727,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/c1e47969-12ff-45fb-98a2-bf91de99d9cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70809,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/fc27f0b3-e00d-42de-a38c-270091339ce0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190de30-27b7-550f-bb67-194c05e7bf77/3190de30-27b7-550f-bb67-194c05e7bf77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71252,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72TVN/2025-11-18/image/f98ca687-1ce9-4a10-b3e3-931c7710ac00_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Tekna 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Tekna 5dr Xtronic',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117076326%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [astonbarclay.gb] INFO: Saving data for 117076326: {'created_time': 1764788434.154674, 'last_price_update_time': 1764788434.154684, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117076326') HTTP/1.1" 204 0
2025-12-03 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cf3de608-a476-56b1-bed3-f5056dcc525e with identifier: 117137704
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cf3de608-a476-56b1-bed3-f5056dcc525e with identifier: 117137704
2025-12-03 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cf3de608-a476-56b1-bed3-f5056dcc525e with identifier: 117137704 to the API
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117137704?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf3de608-a476-56b1-bed3-f5056dcc525e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BD72FWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117137704',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 34813,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BD72FWG/2025-11-17/image/e4f2be7f-9f9d-449e-ae25-b7e63c05e8f1_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/64614c15-5add-4b7f-87b4-1fe96fb64dcb_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/083bccc7-9594-409b-986c-1a4212ea33f4_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/217f7418-d922-44e5-94be-064d62aad894_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/9a6d3bef-cc64-43a6-b374-03a6c6662756_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/c14abe0d-f637-4b7a-babb-7d9f8f485d5c_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/921c0246-e97f-4b1c-9c77-752584413658_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/5dc37943-a215-4202-b26f-8c098947ba62_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31323,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/e4f2be7f-9f9d-449e-ae25-b7e63c05e8f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31399,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/64614c15-5add-4b7f-87b4-1fe96fb64dcb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31582,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/083bccc7-9594-409b-986c-1a4212ea33f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30455,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/217f7418-d922-44e5-94be-064d62aad894_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51471,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/9a6d3bef-cc64-43a6-b374-03a6c6662756_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38586,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/c14abe0d-f637-4b7a-babb-7d9f8f485d5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52941,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/921c0246-e97f-4b1c-9c77-752584413658_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de608-a476-56b1-bed3-f5056dcc525e/cf3de608-a476-56b1-bed3-f5056dcc525e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50143,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD72FWG/2025-11-17/image/5dc37943-a215-4202-b26f-8c098947ba62_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Prem [Glass Rf] '
          '5dr Xtron',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Acenta Prem [Glass Rf] 5dr Xtron',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117137704%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [astonbarclay.gb] INFO: Saving data for 117137704: {'created_time': 1764788434.750567, 'last_price_update_time': 1764788434.750583, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117137704') HTTP/1.1" 204 0
2025-12-03 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/ff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116196559?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116295138?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117274570, 'registration': 'MM23UXO', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q8 E-TRON SPORTBACK', 'derivative': '250kW 50 Quattro 95kWh Sport 5dr Auto', 'mileage': 25701, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 100, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-06-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/24-18K', 'remarks': 'Soneira Red Metallic', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/03f5fcb5-d87a-4b27-a11e-e5015e022e9c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117274570, 'registration': 'MM23UXO', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q8 E-TRON SPORTBACK', 'derivative': '250kW 50 Quattro 95kWh Sport 5dr Auto', 'mileage': 25701, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 100, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-06-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/24-18K', 'remarks': 'Soneira Red Metallic', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/03f5fcb5-d87a-4b27-a11e-e5015e022e9c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1deeafe-f91d-53d4-83e7-f5fe3b925a34 with identifier: 117274570
2025-12-03 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34 with scrape type 1
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116987948, 'registration': 'BP72TXC', 'account': 'RCI002', 'make': 'RENAULT', 'model': 'MEGANE E-TECH HATCHBACK SPECIAL EDITION', 'derivative': 'EV60 160kW Launch Edition 60kWh OC 5dr Auto', 'mileage': 28165, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 261, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-28', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'], 'colour': 'BLACK/GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aac5a4e-b6ec-43cb-b094-6e0e37e03ba2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116987948, 'registration': 'BP72TXC', 'account': 'RCI002', 'make': 'RENAULT', 'model': 'MEGANE E-TECH HATCHBACK SPECIAL EDITION', 'derivative': 'EV60 160kW Launch Edition 60kWh OC 5dr Auto', 'mileage': 28165, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 261, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-28', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'], 'colour': 'BLACK/GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aac5a4e-b6ec-43cb-b094-6e0e37e03ba2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0740acfa-a480-57ba-9845-3e3d253e10fa with identifier: 116987948
2025-12-03 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0740acfa-a480-57ba-9845-3e3d253e10fa with scrape type 1
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0740acfa-a480-57ba-9845-3e3d253e10fa
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252F13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252F2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252Fe0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252F5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252F81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252Fdbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252F88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP72TXC%252F2025-11-10%252Fimage%252Faed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0740acfa-a480-57ba-9845-3e3d253e10fa, identifier: 116987948
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117441244
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441244%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117441244: 2
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fe43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252Fe79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/e79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0740acfa-a480-57ba-9845-3e3d253e10fa with identifier: 116987948
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK%2FGREY HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0740acfa-a480-57ba-9845-3e3d253e10fa with identifier: 116987948
2025-12-03 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'renault megane e-tech hatchback special edition ev60 160kw launch edition 60kwh oc 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'megane e-tech hatchback special edition', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 28165, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116987948', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'ev60 160kw launch edition 60kwh oc 5dr auto', 'license_plate': 'bp72txc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'photo_urls': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'], 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '0740acfa-a480-57ba-9845-3e3d253e10fa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34209}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33240}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56690}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 73037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 70968}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'renault megane e-tech hatchback special edition', 'sanitized_make': 'renault', 'odometer_in_km': 45327} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '0740acfa-a480-57ba-9845-3e3d253e10fa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'bp72txc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116987948',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'renault',
     'make_model': 'renault megane e-tech hatchback special edition',
     'model': 'megane e-tech hatchback special edition',
     'odometer': 28165,
     'odometer_in_km': 45327,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photo_urls': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34209,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34495,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33240,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33472,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56690,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73037,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50476,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70968,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-28',
     'sanitized_make': 'renault',
     'seller_name': 'mobilize financial services',
     'title': 'renault megane e-tech hatchback special edition ev60 160kw '
              'launch edition 60kwh oc 5dr auto',
     'transmission': 'automatic',
     'trim': 'ev60 160kw launch edition 60kwh oc 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-03 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 0740acfa-a480-57ba-9845-3e3d253e10fa spider: astonbarclay.gb
2025-12-03 19:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0740acfa-a480-57ba-9845-3e3d253e10fa due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'renault megane e-tech hatchback special edition ev60 160kw launch edition 60kwh oc 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'megane e-tech hatchback special edition', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 28165, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116987948', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'ev60 160kw launch edition 60kwh oc 5dr auto', 'license_plate': 'bp72txc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'photo_urls': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'], 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '0740acfa-a480-57ba-9845-3e3d253e10fa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34209}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33240}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56690}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 73037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 70968}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'renault megane e-tech hatchback special edition', 'sanitized_make': 'renault', 'odometer_in_km': 45327} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '0740acfa-a480-57ba-9845-3e3d253e10fa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'bp72txc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116987948',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'renault',
     'make_model': 'renault megane e-tech hatchback special edition',
     'model': 'megane e-tech hatchback special edition',
     'odometer': 28165,
     'odometer_in_km': 45327,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photo_urls': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600',
                    'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34209,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34495,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33240,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33472,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56690,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73037,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50476,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70968,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-28',
     'sanitized_make': 'renault',
     'seller_name': 'mobilize financial services',
     'title': 'renault megane e-tech hatchback special edition ev60 160kw '
              'launch edition 60kwh oc 5dr auto',
     'transmission': 'automatic',
     'trim': 'ev60 160kw launch edition 60kwh oc 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '0740acfa-a480-57ba-9845-3e3d253e10fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP72TXC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116987948',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'RENAULT',
 'model': 'MEGANE E-TECH HATCHBACK SPECIAL EDITION',
 'odometer': 28165,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34209,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/13d5becb-cac7-4c71-9bfe-7805f631ebca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34495,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/2816c0be-b9a7-49e6-a359-5e0927d27f30_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33240,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/e0f866ba-1d97-4273-8f02-31cffcf8063c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33472,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/5b645930-21f3-4da6-9894-b6f17d70c95e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56690,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/81542fa0-bb04-43ac-a5e7-69b8724ff8bf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73037,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/dbbf8f2c-b020-4507-bf56-c6525903b1fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50476,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/88642f65-c475-46a6-8400-d03f0087d992_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0740acfa-a480-57ba-9845-3e3d253e10fa/0740acfa-a480-57ba-9845-3e3d253e10fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP72TXC/2025-11-10/image/aed35b65-2e1d-4abd-8d82-bcf9608672c7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seller_name': 'Mobilize Financial Services',
 'title': 'RENAULT MEGANE E-TECH HATCHBACK SPECIAL EDITION EV60 160kW Launch '
          'Edition 60kWh OC 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EV60 160kW Launch Edition 60kWh OC 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116987948%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Saving data for 116987948: {'created_time': 1764788435.592047, 'last_price_update_time': 1764788435.592056, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116987948') HTTP/1.1" 204 0
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116876236?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117441120
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441120%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117441120: 0
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117441140
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441140%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117441140: 2
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eec02d0>
2025-12-03 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116196559, 'registration': 'BG72NFX', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 11569, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 266, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BG72NFX/2025-10-14/image/29e2e4e3-e13e-4679-972a-ec7d7ffd7a06_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/98181a85-cd1b-4d00-9fd3-ba8908ad445e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9751e0bc-cfd8-4f1c-9f0b-993e8e83006d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/e2a56b6b-c679-4492-aa26-f2cb4ba2624f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9662ea16-ee9e-4d05-a38e-af2144c3e328_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/8fc9b62a-1b6e-48ff-a0e4-a22979664719_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/cbdbc9ac-548f-4418-beb5-4aba0a634a5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/874bd5ed-fc7f-4c66-b656-c6d15715cd1b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'BLANK BOOK, SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bb2b0ef5-a49d-4d58-9c5d-28729ea2953a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116196559, 'registration': 'BG72NFX', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 11569, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 266, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BG72NFX/2025-10-14/image/29e2e4e3-e13e-4679-972a-ec7d7ffd7a06_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/98181a85-cd1b-4d00-9fd3-ba8908ad445e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9751e0bc-cfd8-4f1c-9f0b-993e8e83006d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/e2a56b6b-c679-4492-aa26-f2cb4ba2624f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9662ea16-ee9e-4d05-a38e-af2144c3e328_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/8fc9b62a-1b6e-48ff-a0e4-a22979664719_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/cbdbc9ac-548f-4418-beb5-4aba0a634a5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/874bd5ed-fc7f-4c66-b656-c6d15715cd1b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'BLANK BOOK, SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bb2b0ef5-a49d-4d58-9c5d-28729ea2953a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e52954c7-9b8d-53d6-b88b-58b3195f103d with identifier: 116196559
2025-12-03 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52954c7-9b8d-53d6-b88b-58b3195f103d with scrape type 1
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e52954c7-9b8d-53d6-b88b-58b3195f103d
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252F29e2e4e3-e13e-4679-972a-ec7d7ffd7a06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/29e2e4e3-e13e-4679-972a-ec7d7ffd7a06_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252F98181a85-cd1b-4d00-9fd3-ba8908ad445e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/98181a85-cd1b-4d00-9fd3-ba8908ad445e_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252F9751e0bc-cfd8-4f1c-9f0b-993e8e83006d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9751e0bc-cfd8-4f1c-9f0b-993e8e83006d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252Fe2a56b6b-c679-4492-aa26-f2cb4ba2624f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/e2a56b6b-c679-4492-aa26-f2cb4ba2624f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252F9662ea16-ee9e-4d05-a38e-af2144c3e328_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9662ea16-ee9e-4d05-a38e-af2144c3e328_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252F8fc9b62a-1b6e-48ff-a0e4-a22979664719_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/8fc9b62a-1b6e-48ff-a0e4-a22979664719_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252Fcbdbc9ac-548f-4418-beb5-4aba0a634a5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/cbdbc9ac-548f-4418-beb5-4aba0a634a5d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72NFX%252F2025-10-14%252Fimage%252F874bd5ed-fc7f-4c66-b656-c6d15715cd1b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72NFX/2025-10-14/image/874bd5ed-fc7f-4c66-b656-c6d15715cd1b_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e52954c7-9b8d-53d6-b88b-58b3195f103d, identifier: 116196559
2025-12-03 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116295138, 'registration': 'YJ74MYW', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Acenta Premium 5dr Auto', 'mileage': 2416, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 264, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-11-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/da51c8a9-ed1c-4187-943e-8fa6e9c2d0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/2f897ad7-8021-4b6a-9a9e-3973432d90dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/c3aa117c-0066-48fa-ae19-6cd933b77ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/75754858-3b56-4020-9d79-ee8ae0560809_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/358d9fd4-d209-4ec2-b149-c660e520dd4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/23928c77-0d46-4298-b898-54795f476d79_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/9966376a-cba8-467f-ba2c-ce9642da0cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/aa544a42-2257-4646-8dab-8b28cf70a2b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, BLANK BOOK', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 91, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/918e23ec-c6fa-4cf1-9163-ec924e871151.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116295138, 'registration': 'YJ74MYW', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Acenta Premium 5dr Auto', 'mileage': 2416, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 264, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-11-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/da51c8a9-ed1c-4187-943e-8fa6e9c2d0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/2f897ad7-8021-4b6a-9a9e-3973432d90dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/c3aa117c-0066-48fa-ae19-6cd933b77ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/75754858-3b56-4020-9d79-ee8ae0560809_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/358d9fd4-d209-4ec2-b149-c660e520dd4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/23928c77-0d46-4298-b898-54795f476d79_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/9966376a-cba8-467f-ba2c-ce9642da0cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/aa544a42-2257-4646-8dab-8b28cf70a2b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, BLANK BOOK', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 91, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/918e23ec-c6fa-4cf1-9163-ec924e871151.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73dee7d-0d9b-50f1-9e70-08f8c8a6e196 with identifier: 116295138
2025-12-03 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73dee7d-0d9b-50f1-9e70-08f8c8a6e196 with scrape type 1
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a73dee7d-0d9b-50f1-9e70-08f8c8a6e196
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252Fda51c8a9-ed1c-4187-943e-8fa6e9c2d0c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/da51c8a9-ed1c-4187-943e-8fa6e9c2d0c2_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252F2f897ad7-8021-4b6a-9a9e-3973432d90dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/2f897ad7-8021-4b6a-9a9e-3973432d90dd_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252Fc3aa117c-0066-48fa-ae19-6cd933b77ad6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/c3aa117c-0066-48fa-ae19-6cd933b77ad6_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252F75754858-3b56-4020-9d79-ee8ae0560809_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/75754858-3b56-4020-9d79-ee8ae0560809_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252F358d9fd4-d209-4ec2-b149-c660e520dd4a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/358d9fd4-d209-4ec2-b149-c660e520dd4a_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252F23928c77-0d46-4298-b898-54795f476d79_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/23928c77-0d46-4298-b898-54795f476d79_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252F9966376a-cba8-467f-ba2c-ce9642da0cb0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/9966376a-cba8-467f-ba2c-ce9642da0cb0_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYJ74MYW%252F2025-10-13%252Fimage%252Faa544a42-2257-4646-8dab-8b28cf70a2b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/aa544a42-2257-4646-8dab-8b28cf70a2b5_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a73dee7d-0d9b-50f1-9e70-08f8c8a6e196, identifier: 116295138
2025-12-03 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fb3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/b3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117335606?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e52954c7-9b8d-53d6-b88b-58b3195f103d with identifier: 116196559
2025-12-03 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e52954c7-9b8d-53d6-b88b-58b3195f103d with identifier: 116196559
2025-12-03 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e52954c7-9b8d-53d6-b88b-58b3195f103d with identifier: 116196559 to the API
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116196559?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e52954c7-9b8d-53d6-b88b-58b3195f103d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BG72NFX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116196559',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 11569,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BG72NFX/2025-10-14/image/29e2e4e3-e13e-4679-972a-ec7d7ffd7a06_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/98181a85-cd1b-4d00-9fd3-ba8908ad445e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9751e0bc-cfd8-4f1c-9f0b-993e8e83006d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/e2a56b6b-c679-4492-aa26-f2cb4ba2624f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9662ea16-ee9e-4d05-a38e-af2144c3e328_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/8fc9b62a-1b6e-48ff-a0e4-a22979664719_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/cbdbc9ac-548f-4418-beb5-4aba0a634a5d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/874bd5ed-fc7f-4c66-b656-c6d15715cd1b_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31090,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/29e2e4e3-e13e-4679-972a-ec7d7ffd7a06_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30964,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/98181a85-cd1b-4d00-9fd3-ba8908ad445e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34479,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9751e0bc-cfd8-4f1c-9f0b-993e8e83006d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32386,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/e2a56b6b-c679-4492-aa26-f2cb4ba2624f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51210,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/9662ea16-ee9e-4d05-a38e-af2144c3e328_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49104,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/8fc9b62a-1b6e-48ff-a0e4-a22979664719_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56522,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/cbdbc9ac-548f-4418-beb5-4aba0a634a5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52954c7-9b8d-53d6-b88b-58b3195f103d/e52954c7-9b8d-53d6-b88b-58b3195f103d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48385,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72NFX/2025-10-14/image/874bd5ed-fc7f-4c66-b656-c6d15715cd1b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-24',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116196559%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [astonbarclay.gb] INFO: Saving data for 116196559: {'created_time': 1764788437.021798, 'last_price_update_time': 1764788437.021808, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116196559') HTTP/1.1" 204 0
2025-12-03 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a73dee7d-0d9b-50f1-9e70-08f8c8a6e196 with identifier: 116295138
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric+Hybrid HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a73dee7d-0d9b-50f1-9e70-08f8c8a6e196 with identifier: 116295138
2025-12-03 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a73dee7d-0d9b-50f1-9e70-08f8c8a6e196 with identifier: 116295138 to the API
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116295138?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'a73dee7d-0d9b-50f1-9e70-08f8c8a6e196',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YJ74MYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116295138',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 2416,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/da51c8a9-ed1c-4187-943e-8fa6e9c2d0c2_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/2f897ad7-8021-4b6a-9a9e-3973432d90dd_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/c3aa117c-0066-48fa-ae19-6cd933b77ad6_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/75754858-3b56-4020-9d79-ee8ae0560809_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/358d9fd4-d209-4ec2-b149-c660e520dd4a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/23928c77-0d46-4298-b898-54795f476d79_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/9966376a-cba8-467f-ba2c-ce9642da0cb0_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/aa544a42-2257-4646-8dab-8b28cf70a2b5_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35425,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/da51c8a9-ed1c-4187-943e-8fa6e9c2d0c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33884,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/2f897ad7-8021-4b6a-9a9e-3973432d90dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32728,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/c3aa117c-0066-48fa-ae19-6cd933b77ad6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33043,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/75754858-3b56-4020-9d79-ee8ae0560809_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55735,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/358d9fd4-d209-4ec2-b149-c660e520dd4a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56047,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/23928c77-0d46-4298-b898-54795f476d79_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61718,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/9966376a-cba8-467f-ba2c-ce9642da0cb0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73dee7d-0d9b-50f1-9e70-08f8c8a6e196/a73dee7d-0d9b-50f1-9e70-08f8c8a6e196_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61532,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YJ74MYW/2025-10-13/image/aa544a42-2257-4646-8dab-8b28cf70a2b5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power Acenta Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power Acenta Premium 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116295138%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [astonbarclay.gb] INFO: Saving data for 116295138: {'created_time': 1764788437.477574, 'last_price_update_time': 1764788437.477584, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116295138') HTTP/1.1" 204 0
2025-12-03 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117441149
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441149%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117441149: 2
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117059866?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116401849?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116963987?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117069920?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116876236, 'registration': 'DV72MKC', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 26010, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 267, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72MKC/2025-11-10/image/cef039d4-3d66-45b8-9e85-390dd0f569f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/0d1fc6d5-2627-4217-9190-4df0d6186bcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/89d4b8f9-d9e9-4d26-b6cf-9524de6ddc5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/f8e1b78c-bb15-43e4-8a33-efcdfa670f9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/60339169-c7b3-47c3-97cb-ba298e8a6d2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/a38fb8ec-6dcd-4693-9354-3571ac1aaa9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/c354edb5-2b96-41a1-be0a-4e6d16c59e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/5db9e3af-fcd2-421b-9447-911bc6c275fc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23 9K 11/24 20K', 'remarks': 'VOSA STATES 25K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/950e3a84-2ad7-41bf-9b85-880dff80ace6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116876236, 'registration': 'DV72MKC', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 26010, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 267, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72MKC/2025-11-10/image/cef039d4-3d66-45b8-9e85-390dd0f569f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/0d1fc6d5-2627-4217-9190-4df0d6186bcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/89d4b8f9-d9e9-4d26-b6cf-9524de6ddc5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/f8e1b78c-bb15-43e4-8a33-efcdfa670f9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/60339169-c7b3-47c3-97cb-ba298e8a6d2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/a38fb8ec-6dcd-4693-9354-3571ac1aaa9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/c354edb5-2b96-41a1-be0a-4e6d16c59e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/5db9e3af-fcd2-421b-9447-911bc6c275fc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23 9K 11/24 20K', 'remarks': 'VOSA STATES 25K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/950e3a84-2ad7-41bf-9b85-880dff80ace6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba02966-3827-542a-835c-169cf5109434 with identifier: 116876236
2025-12-03 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba02966-3827-542a-835c-169cf5109434 with scrape type 1
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4ba02966-3827-542a-835c-169cf5109434
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252Fcef039d4-3d66-45b8-9e85-390dd0f569f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/cef039d4-3d66-45b8-9e85-390dd0f569f7_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252F0d1fc6d5-2627-4217-9190-4df0d6186bcb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/0d1fc6d5-2627-4217-9190-4df0d6186bcb_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252F89d4b8f9-d9e9-4d26-b6cf-9524de6ddc5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/89d4b8f9-d9e9-4d26-b6cf-9524de6ddc5f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252Ff8e1b78c-bb15-43e4-8a33-efcdfa670f9b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/f8e1b78c-bb15-43e4-8a33-efcdfa670f9b_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252F60339169-c7b3-47c3-97cb-ba298e8a6d2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/60339169-c7b3-47c3-97cb-ba298e8a6d2f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252Fa38fb8ec-6dcd-4693-9354-3571ac1aaa9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/a38fb8ec-6dcd-4693-9354-3571ac1aaa9a_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252Fc354edb5-2b96-41a1-be0a-4e6d16c59e50_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/c354edb5-2b96-41a1-be0a-4e6d16c59e50_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72MKC%252F2025-11-10%252Fimage%252F5db9e3af-fcd2-421b-9447-911bc6c275fc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72MKC/2025-11-10/image/5db9e3af-fcd2-421b-9447-911bc6c275fc_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4ba02966-3827-542a-835c-169cf5109434, identifier: 116876236
2025-12-03 19:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee354d0>
2025-12-03 19:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Fa4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/fe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117441190
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441190%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117441190: 2
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4ba02966-3827-542a-835c-169cf5109434 with identifier: 116876236
2025-12-03 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4ba02966-3827-542a-835c-169cf5109434 with identifier: 116876236
2025-12-03 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4ba02966-3827-542a-835c-169cf5109434 with identifier: 116876236 to the API
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116876236?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4ba02966-3827-542a-835c-169cf5109434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV72MKC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116876236',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 26010,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DV72MKC/2025-11-10/image/cef039d4-3d66-45b8-9e85-390dd0f569f7_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/0d1fc6d5-2627-4217-9190-4df0d6186bcb_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/89d4b8f9-d9e9-4d26-b6cf-9524de6ddc5f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/f8e1b78c-bb15-43e4-8a33-efcdfa670f9b_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/60339169-c7b3-47c3-97cb-ba298e8a6d2f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/a38fb8ec-6dcd-4693-9354-3571ac1aaa9a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/c354edb5-2b96-41a1-be0a-4e6d16c59e50_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/5db9e3af-fcd2-421b-9447-911bc6c275fc_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36356,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/cef039d4-3d66-45b8-9e85-390dd0f569f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37427,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/0d1fc6d5-2627-4217-9190-4df0d6186bcb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37035,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/89d4b8f9-d9e9-4d26-b6cf-9524de6ddc5f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34220,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/f8e1b78c-bb15-43e4-8a33-efcdfa670f9b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51730,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/60339169-c7b3-47c3-97cb-ba298e8a6d2f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45974,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/a38fb8ec-6dcd-4693-9354-3571ac1aaa9a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43768,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/c354edb5-2b96-41a1-be0a-4e6d16c59e50_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba02966-3827-542a-835c-169cf5109434/4ba02966-3827-542a-835c-169cf5109434_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72MKC/2025-11-10/image/5db9e3af-fcd2-421b-9447-911bc6c275fc_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116876236%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [astonbarclay.gb] INFO: Saving data for 116876236: {'created_time': 1764788438.425672, 'last_price_update_time': 1764788438.425681, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116876236') HTTP/1.1" 204 0
2025-12-03 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/e79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee17a10>
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117335606, 'registration': 'DN71BLX', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic', 'mileage': 83618, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 268, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-13', 'fuel': 'Petrol', 'motExpiry': '2025-12-12', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN71BLX/2025-11-20/image/91501034-e5c4-4f44-9215-0673b136ce89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/3fc873a8-02bc-4415-9cfd-dfaa8972c03c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/0372dde8-e54a-476c-af6e-8f2974523dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/8f852738-a2c4-4a46-8147-7d77e09d22ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/c9dc167b-a704-492e-bcae-363721002cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/ea918f21-b262-4c89-a25d-dac042cc890e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/db7e7066-ced5-4494-96aa-f733377bb93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/81c8764e-24b0-4eda-a828-c06c65a3ae5e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/24 19K 12/23 41K 11/24 63K', 'remarks': 'VOSA STATES 63K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf0f8008-2cca-422e-9483-ff38feec5f57.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117335606, 'registration': 'DN71BLX', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic', 'mileage': 83618, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 268, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-13', 'fuel': 'Petrol', 'motExpiry': '2025-12-12', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN71BLX/2025-11-20/image/91501034-e5c4-4f44-9215-0673b136ce89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/3fc873a8-02bc-4415-9cfd-dfaa8972c03c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/0372dde8-e54a-476c-af6e-8f2974523dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/8f852738-a2c4-4a46-8147-7d77e09d22ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/c9dc167b-a704-492e-bcae-363721002cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/ea918f21-b262-4c89-a25d-dac042cc890e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/db7e7066-ced5-4494-96aa-f733377bb93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/81c8764e-24b0-4eda-a828-c06c65a3ae5e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/24 19K 12/23 41K 11/24 63K', 'remarks': 'VOSA STATES 63K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf0f8008-2cca-422e-9483-ff38feec5f57.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14 with identifier: 117335606
2025-12-03 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14 with scrape type 1
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252F91501034-e5c4-4f44-9215-0673b136ce89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/91501034-e5c4-4f44-9215-0673b136ce89_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252F3fc873a8-02bc-4415-9cfd-dfaa8972c03c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/3fc873a8-02bc-4415-9cfd-dfaa8972c03c_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252F0372dde8-e54a-476c-af6e-8f2974523dac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/0372dde8-e54a-476c-af6e-8f2974523dac_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252F8f852738-a2c4-4a46-8147-7d77e09d22ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/8f852738-a2c4-4a46-8147-7d77e09d22ad_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252Fc9dc167b-a704-492e-bcae-363721002cd7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/c9dc167b-a704-492e-bcae-363721002cd7_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252Fea918f21-b262-4c89-a25d-dac042cc890e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/ea918f21-b262-4c89-a25d-dac042cc890e_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252Fdb7e7066-ced5-4494-96aa-f733377bb93d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/db7e7066-ced5-4494-96aa-f733377bb93d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDN71BLX%252F2025-11-20%252Fimage%252F81c8764e-24b0-4eda-a828-c06c65a3ae5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DN71BLX/2025-11-20/image/81c8764e-24b0-4eda-a828-c06c65a3ae5e_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14, identifier: 117335606
2025-12-03 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/acd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117572022
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572022%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117572022: 2
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14 with identifier: 117335606
2025-12-03 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14 with identifier: 117335606
2025-12-03 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 203a0d64-cc62-5adf-b8fd-f57b9f2cdc14 with identifier: 117335606 to the API
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117335606?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '203a0d64-cc62-5adf-b8fd-f57b9f2cdc14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DN71BLX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117335606',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 83618,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DN71BLX/2025-11-20/image/91501034-e5c4-4f44-9215-0673b136ce89_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/3fc873a8-02bc-4415-9cfd-dfaa8972c03c_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/0372dde8-e54a-476c-af6e-8f2974523dac_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/8f852738-a2c4-4a46-8147-7d77e09d22ad_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/c9dc167b-a704-492e-bcae-363721002cd7_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/ea918f21-b262-4c89-a25d-dac042cc890e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/db7e7066-ced5-4494-96aa-f733377bb93d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/81c8764e-24b0-4eda-a828-c06c65a3ae5e_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25785,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/91501034-e5c4-4f44-9215-0673b136ce89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27498,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/3fc873a8-02bc-4415-9cfd-dfaa8972c03c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26492,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/0372dde8-e54a-476c-af6e-8f2974523dac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24696,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/8f852738-a2c4-4a46-8147-7d77e09d22ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47966,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/c9dc167b-a704-492e-bcae-363721002cd7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41557,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/ea918f21-b262-4c89-a25d-dac042cc890e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42476,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/db7e7066-ced5-4494-96aa-f733377bb93d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203a0d64-cc62-5adf-b8fd-f57b9f2cdc14/203a0d64-cc62-5adf-b8fd-f57b9f2cdc14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45038,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DN71BLX/2025-11-20/image/81c8764e-24b0-4eda-a828-c06c65a3ae5e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic',
 'vin': None,
 'year': 2021}
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117335606%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Saving data for 117335606: {'created_time': 1764788439.452694, 'last_price_update_time': 1764788439.452703, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117335606') HTTP/1.1" 204 0
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117059866, 'registration': 'BK73LXR', 'account': 'RCI001', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.6 E-Tech Plug-in hybrid 160 Engineered 5dr Auto', 'mileage': 36403, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 269, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-02', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f6d76de3-8f8b-4d9e-8021-06b2cb9b6a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ae8270b3-efd4-41a9-8b7a-f07b3ef47f7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/6ebd8ea6-2368-4143-852a-6dfe4d08a8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/3c010aa7-d397-466a-a323-b30fcd513042_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/7588ac35-1b1d-4549-96ea-c1081660fe03_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ebd9cd3f-7b9f-475f-9725-ee8c7d31b041_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/1a1368dd-80fb-427c-ae79-ca707910fd03_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f1498de1-9478-4020-80c7-885a895f741c_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5fe1fd24-c0a1-4d6c-80ff-8b2da1d63cb6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117059866, 'registration': 'BK73LXR', 'account': 'RCI001', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.6 E-Tech Plug-in hybrid 160 Engineered 5dr Auto', 'mileage': 36403, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 269, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-02', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f6d76de3-8f8b-4d9e-8021-06b2cb9b6a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ae8270b3-efd4-41a9-8b7a-f07b3ef47f7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/6ebd8ea6-2368-4143-852a-6dfe4d08a8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/3c010aa7-d397-466a-a323-b30fcd513042_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/7588ac35-1b1d-4549-96ea-c1081660fe03_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ebd9cd3f-7b9f-475f-9725-ee8c7d31b041_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/1a1368dd-80fb-427c-ae79-ca707910fd03_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f1498de1-9478-4020-80c7-885a895f741c_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5fe1fd24-c0a1-4d6c-80ff-8b2da1d63cb6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6941e3-aeb4-51d6-9259-0ffdee015ff6 with identifier: 117059866
2025-12-03 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6941e3-aeb4-51d6-9259-0ffdee015ff6 with scrape type 1
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9b6941e3-aeb4-51d6-9259-0ffdee015ff6
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252Ff6d76de3-8f8b-4d9e-8021-06b2cb9b6a8d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f6d76de3-8f8b-4d9e-8021-06b2cb9b6a8d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252Fae8270b3-efd4-41a9-8b7a-f07b3ef47f7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ae8270b3-efd4-41a9-8b7a-f07b3ef47f7d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252F6ebd8ea6-2368-4143-852a-6dfe4d08a8c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/6ebd8ea6-2368-4143-852a-6dfe4d08a8c3_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252F3c010aa7-d397-466a-a323-b30fcd513042_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/3c010aa7-d397-466a-a323-b30fcd513042_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252F7588ac35-1b1d-4549-96ea-c1081660fe03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/7588ac35-1b1d-4549-96ea-c1081660fe03_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252Febd9cd3f-7b9f-475f-9725-ee8c7d31b041_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ebd9cd3f-7b9f-475f-9725-ee8c7d31b041_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252F1a1368dd-80fb-427c-ae79-ca707910fd03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/1a1368dd-80fb-427c-ae79-ca707910fd03_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK73LXR%252F2025-11-10%252Fimage%252Ff1498de1-9478-4020-80c7-885a895f741c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f1498de1-9478-4020-80c7-885a895f741c_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9b6941e3-aeb4-51d6-9259-0ffdee015ff6, identifier: 117059866
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116401849, 'registration': 'DL24PFZ', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr', 'mileage': 17260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 270, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2024-06-24', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/9b9ab948-c4a7-424f-be44-ed67abe5a86a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c42b6d03-c064-44ff-8d04-bf21c7900514_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/8845c8e4-7594-4185-b12d-5acec8765bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4d9581ce-c4af-4740-8894-380ddc443c7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c5966b5e-f7a9-4af1-9b4c-db9762ae8dbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/ef45e173-f558-4ba1-babd-bce70ef44b09_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4fcfadf4-2f47-4ab9-a83e-0d6a547bf531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/a0f621f2-1a9a-4c1d-8d36-03c852706611_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/25 13K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/af30ef49-7365-40a8-b120-bd3968d9fa59.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116401849, 'registration': 'DL24PFZ', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr', 'mileage': 17260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 270, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2024-06-24', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/9b9ab948-c4a7-424f-be44-ed67abe5a86a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c42b6d03-c064-44ff-8d04-bf21c7900514_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/8845c8e4-7594-4185-b12d-5acec8765bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4d9581ce-c4af-4740-8894-380ddc443c7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c5966b5e-f7a9-4af1-9b4c-db9762ae8dbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/ef45e173-f558-4ba1-babd-bce70ef44b09_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4fcfadf4-2f47-4ab9-a83e-0d6a547bf531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/a0f621f2-1a9a-4c1d-8d36-03c852706611_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/25 13K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/af30ef49-7365-40a8-b120-bd3968d9fa59.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8194c01-4062-5831-8da1-a9ed3cd47382 with identifier: 116401849
2025-12-03 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8194c01-4062-5831-8da1-a9ed3cd47382 with scrape type 1
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b8194c01-4062-5831-8da1-a9ed3cd47382
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252F9b9ab948-c4a7-424f-be44-ed67abe5a86a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/9b9ab948-c4a7-424f-be44-ed67abe5a86a_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252Fc42b6d03-c064-44ff-8d04-bf21c7900514_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c42b6d03-c064-44ff-8d04-bf21c7900514_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252F8845c8e4-7594-4185-b12d-5acec8765bf3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/8845c8e4-7594-4185-b12d-5acec8765bf3_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252F4d9581ce-c4af-4740-8894-380ddc443c7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4d9581ce-c4af-4740-8894-380ddc443c7f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252Fc5966b5e-f7a9-4af1-9b4c-db9762ae8dbc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c5966b5e-f7a9-4af1-9b4c-db9762ae8dbc_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252Fef45e173-f558-4ba1-babd-bce70ef44b09_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/ef45e173-f558-4ba1-babd-bce70ef44b09_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252F4fcfadf4-2f47-4ab9-a83e-0d6a547bf531_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4fcfadf4-2f47-4ab9-a83e-0d6a547bf531_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL24PFZ%252F2025-10-16%252Fimage%252Fa0f621f2-1a9a-4c1d-8d36-03c852706611_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/a0f621f2-1a9a-4c1d-8d36-03c852706611_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b8194c01-4062-5831-8da1-a9ed3cd47382, identifier: 116401849
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116963987, 'registration': 'DV73GFG', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 18459, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 272, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV73GFG/2025-11-10/image/4efa4373-bbea-4fd9-b884-fb90dbb67c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/e588ea51-dc84-4c9c-9fa1-be70dd2ba49d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/53c58f97-5bdc-48a9-b66e-5b3bc11f4605_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/a1f356bc-3454-4cc3-a42c-bf8b8c71163f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/188fd483-c4f9-4912-b3a3-37d7c729d10e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/011c982e-301f-4720-b84c-f9b1ad871466_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/59778bc4-5f97-4d4c-8abf-756ccb0a0f4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/b34b1e8e-3f93-46e2-82c8-be303e88a859_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ede09b7b-ffb1-4c75-89bd-54f2380bd1e3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116963987, 'registration': 'DV73GFG', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 18459, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 272, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV73GFG/2025-11-10/image/4efa4373-bbea-4fd9-b884-fb90dbb67c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/e588ea51-dc84-4c9c-9fa1-be70dd2ba49d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/53c58f97-5bdc-48a9-b66e-5b3bc11f4605_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/a1f356bc-3454-4cc3-a42c-bf8b8c71163f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/188fd483-c4f9-4912-b3a3-37d7c729d10e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/011c982e-301f-4720-b84c-f9b1ad871466_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/59778bc4-5f97-4d4c-8abf-756ccb0a0f4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/b34b1e8e-3f93-46e2-82c8-be303e88a859_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ede09b7b-ffb1-4c75-89bd-54f2380bd1e3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9f5b69-4f66-59e3-b972-b16b295e214a with identifier: 116963987
2025-12-03 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9f5b69-4f66-59e3-b972-b16b295e214a with scrape type 1
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2b9f5b69-4f66-59e3-b972-b16b295e214a
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252F4efa4373-bbea-4fd9-b884-fb90dbb67c4f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/4efa4373-bbea-4fd9-b884-fb90dbb67c4f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252Fe588ea51-dc84-4c9c-9fa1-be70dd2ba49d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/e588ea51-dc84-4c9c-9fa1-be70dd2ba49d_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252F53c58f97-5bdc-48a9-b66e-5b3bc11f4605_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/53c58f97-5bdc-48a9-b66e-5b3bc11f4605_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252Fa1f356bc-3454-4cc3-a42c-bf8b8c71163f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/a1f356bc-3454-4cc3-a42c-bf8b8c71163f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252F188fd483-c4f9-4912-b3a3-37d7c729d10e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/188fd483-c4f9-4912-b3a3-37d7c729d10e_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252F011c982e-301f-4720-b84c-f9b1ad871466_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/011c982e-301f-4720-b84c-f9b1ad871466_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252F59778bc4-5f97-4d4c-8abf-756ccb0a0f4e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/59778bc4-5f97-4d4c-8abf-756ccb0a0f4e_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV73GFG%252F2025-11-10%252Fimage%252Fb34b1e8e-3f93-46e2-82c8-be303e88a859_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV73GFG/2025-11-10/image/b34b1e8e-3f93-46e2-82c8-be303e88a859_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2b9f5b69-4f66-59e3-b972-b16b295e214a, identifier: 116963987
2025-12-03 19:00:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117069920, 'registration': 'DS22PEO', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 17312, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 271, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-02', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS22PEO/2025-11-19/image/0bcd0bca-6133-47d4-a183-26f3b86a79f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/43cf12de-3959-402a-b761-68eb29ffa732_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/316c1b8b-2a9e-4b15-9749-4590ab01cdc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/b1a83994-b5b8-45de-86fc-82e7c1d7666a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/450f5f19-8e80-4ef5-a90d-1aeb6564948f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/279f4c6e-df69-40b6-bae7-3d4a55e4ac39_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/796bca19-3647-4c10-a5b5-cbe546765034_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/d8edfa18-db52-4c66-8204-46690de044ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/70e21b97-6a58-4142-834d-adef252055c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117069920, 'registration': 'DS22PEO', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 17312, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 271, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-02', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS22PEO/2025-11-19/image/0bcd0bca-6133-47d4-a183-26f3b86a79f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/43cf12de-3959-402a-b761-68eb29ffa732_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/316c1b8b-2a9e-4b15-9749-4590ab01cdc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/b1a83994-b5b8-45de-86fc-82e7c1d7666a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/450f5f19-8e80-4ef5-a90d-1aeb6564948f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/279f4c6e-df69-40b6-bae7-3d4a55e4ac39_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/796bca19-3647-4c10-a5b5-cbe546765034_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/d8edfa18-db52-4c66-8204-46690de044ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/70e21b97-6a58-4142-834d-adef252055c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6cbf6d-160b-50d6-903b-d4f3f982b2ff with identifier: 117069920
2025-12-03 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6cbf6d-160b-50d6-903b-d4f3f982b2ff with scrape type 1
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fe6cbf6d-160b-50d6-903b-d4f3f982b2ff
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252F0bcd0bca-6133-47d4-a183-26f3b86a79f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/0bcd0bca-6133-47d4-a183-26f3b86a79f7_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252F43cf12de-3959-402a-b761-68eb29ffa732_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/43cf12de-3959-402a-b761-68eb29ffa732_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252F316c1b8b-2a9e-4b15-9749-4590ab01cdc2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/316c1b8b-2a9e-4b15-9749-4590ab01cdc2_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252Fb1a83994-b5b8-45de-86fc-82e7c1d7666a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/b1a83994-b5b8-45de-86fc-82e7c1d7666a_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252F450f5f19-8e80-4ef5-a90d-1aeb6564948f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/450f5f19-8e80-4ef5-a90d-1aeb6564948f_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252F279f4c6e-df69-40b6-bae7-3d4a55e4ac39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/279f4c6e-df69-40b6-bae7-3d4a55e4ac39_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252F796bca19-3647-4c10-a5b5-cbe546765034_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/796bca19-3647-4c10-a5b5-cbe546765034_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS22PEO%252F2025-11-19%252Fimage%252Fd8edfa18-db52-4c66-8204-46690de044ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS22PEO/2025-11-19/image/d8edfa18-db52-4c66-8204-46690de044ba_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fe6cbf6d-160b-50d6-903b-d4f3f982b2ff, identifier: 117069920
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edc3e90>
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebe9b10>
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Ffe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/fe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117394554
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394554%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117394554: 0
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 116879417
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116879417%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Scrape type for 116879417: 0
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117179358
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179358%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117179358: 0
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117539707
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539707%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117539707: 0
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117253439
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253439%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117253439: 2
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fc697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/c697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117457472?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9b6941e3-aeb4-51d6-9259-0ffdee015ff6 with identifier: 117059866
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY%2FBLACK HTTP/1.1" 200 None
2025-12-03 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9b6941e3-aeb4-51d6-9259-0ffdee015ff6 with identifier: 117059866
2025-12-03 19:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9b6941e3-aeb4-51d6-9259-0ffdee015ff6 with identifier: 117059866 to the API
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117059866?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '9b6941e3-aeb4-51d6-9259-0ffdee015ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK73LXR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117059866',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 36403,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f6d76de3-8f8b-4d9e-8021-06b2cb9b6a8d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ae8270b3-efd4-41a9-8b7a-f07b3ef47f7d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/6ebd8ea6-2368-4143-852a-6dfe4d08a8c3_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/3c010aa7-d397-466a-a323-b30fcd513042_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/7588ac35-1b1d-4549-96ea-c1081660fe03_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ebd9cd3f-7b9f-475f-9725-ee8c7d31b041_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/1a1368dd-80fb-427c-ae79-ca707910fd03_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f1498de1-9478-4020-80c7-885a895f741c_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31959,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f6d76de3-8f8b-4d9e-8021-06b2cb9b6a8d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33022,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ae8270b3-efd4-41a9-8b7a-f07b3ef47f7d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/6ebd8ea6-2368-4143-852a-6dfe4d08a8c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32696,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/3c010aa7-d397-466a-a323-b30fcd513042_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51780,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/7588ac35-1b1d-4549-96ea-c1081660fe03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46236,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/ebd9cd3f-7b9f-475f-9725-ee8c7d31b041_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57493,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/1a1368dd-80fb-427c-ae79-ca707910fd03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6941e3-aeb4-51d6-9259-0ffdee015ff6/9b6941e3-aeb4-51d6-9259-0ffdee015ff6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50096,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BK73LXR/2025-11-10/image/f1498de1-9478-4020-80c7-885a895f741c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-02',
 'seller_name': 'Mobilize Financial Services',
 'title': 'RENAULT CAPTUR HATCHBACK 1.6 E-Tech Plug-in hybrid 160 Engineered '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-Tech Plug-in hybrid 160 Engineered 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117059866%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Saving data for 117059866: {'created_time': 1764788441.54228, 'last_price_update_time': 1764788441.54229, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117059866') HTTP/1.1" 204 0
2025-12-03 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b8194c01-4062-5831-8da1-a9ed3cd47382 with identifier: 116401849
2025-12-03 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b8194c01-4062-5831-8da1-a9ed3cd47382 with identifier: 116401849
2025-12-03 19:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b8194c01-4062-5831-8da1-a9ed3cd47382 with identifier: 116401849 to the API
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116401849?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': 'b8194c01-4062-5831-8da1-a9ed3cd47382',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DL24PFZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116401849',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 17260,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/9b9ab948-c4a7-424f-be44-ed67abe5a86a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c42b6d03-c064-44ff-8d04-bf21c7900514_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/8845c8e4-7594-4185-b12d-5acec8765bf3_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4d9581ce-c4af-4740-8894-380ddc443c7f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c5966b5e-f7a9-4af1-9b4c-db9762ae8dbc_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/ef45e173-f558-4ba1-babd-bce70ef44b09_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4fcfadf4-2f47-4ab9-a83e-0d6a547bf531_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/a0f621f2-1a9a-4c1d-8d36-03c852706611_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34022,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/9b9ab948-c4a7-424f-be44-ed67abe5a86a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34429,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c42b6d03-c064-44ff-8d04-bf21c7900514_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33861,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/8845c8e4-7594-4185-b12d-5acec8765bf3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32539,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4d9581ce-c4af-4740-8894-380ddc443c7f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57403,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/c5966b5e-f7a9-4af1-9b4c-db9762ae8dbc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60962,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/ef45e173-f558-4ba1-babd-bce70ef44b09_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65105,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/4fcfadf4-2f47-4ab9-a83e-0d6a547bf531_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8194c01-4062-5831-8da1-a9ed3cd47382/b8194c01-4062-5831-8da1-a9ed3cd47382_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67318,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL24PFZ/2025-10-16/image/a0f621f2-1a9a-4c1d-8d36-03c852706611_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-24',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH 158 N-Connecta 5dr',
 'vin': None,
 'year': 2024}
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116401849%27 HTTP/1.1" 200 None
2025-12-03 19:00:41 [astonbarclay.gb] INFO: Saving data for 116401849: {'created_time': 1764788441.96468, 'last_price_update_time': 1764788441.964689, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116401849') HTTP/1.1" 204 0
2025-12-03 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2b9f5b69-4f66-59e3-b972-b16b295e214a with identifier: 116963987
2025-12-03 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2b9f5b69-4f66-59e3-b972-b16b295e214a with identifier: 116963987
2025-12-03 19:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2b9f5b69-4f66-59e3-b972-b16b295e214a with identifier: 116963987 to the API
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116963987?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2b9f5b69-4f66-59e3-b972-b16b295e214a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV73GFG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116963987',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 18459,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DV73GFG/2025-11-10/image/4efa4373-bbea-4fd9-b884-fb90dbb67c4f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/e588ea51-dc84-4c9c-9fa1-be70dd2ba49d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/53c58f97-5bdc-48a9-b66e-5b3bc11f4605_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/a1f356bc-3454-4cc3-a42c-bf8b8c71163f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/188fd483-c4f9-4912-b3a3-37d7c729d10e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/011c982e-301f-4720-b84c-f9b1ad871466_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/59778bc4-5f97-4d4c-8abf-756ccb0a0f4e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/b34b1e8e-3f93-46e2-82c8-be303e88a859_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33582,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/4efa4373-bbea-4fd9-b884-fb90dbb67c4f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34962,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/e588ea51-dc84-4c9c-9fa1-be70dd2ba49d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32154,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/53c58f97-5bdc-48a9-b66e-5b3bc11f4605_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31972,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/a1f356bc-3454-4cc3-a42c-bf8b8c71163f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53070,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/188fd483-c4f9-4912-b3a3-37d7c729d10e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37515,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/011c982e-301f-4720-b84c-f9b1ad871466_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50461,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/59778bc4-5f97-4d4c-8abf-756ccb0a0f4e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9f5b69-4f66-59e3-b972-b16b295e214a/2b9f5b69-4f66-59e3-b972-b16b295e214a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46451,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV73GFG/2025-11-10/image/b34b1e8e-3f93-46e2-82c8-be303e88a859_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Premium 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic',
 'vin': None,
 'year': 2023}
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963987%27 HTTP/1.1" 200 None
2025-12-03 19:00:42 [astonbarclay.gb] INFO: Saving data for 116963987: {'created_time': 1764788442.284177, 'last_price_update_time': 1764788442.284189, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963987') HTTP/1.1" 204 0
2025-12-03 19:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fe6cbf6d-160b-50d6-903b-d4f3f982b2ff with identifier: 117069920
2025-12-03 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fe6cbf6d-160b-50d6-903b-d4f3f982b2ff with identifier: 117069920
2025-12-03 19:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fe6cbf6d-160b-50d6-903b-d4f3f982b2ff with identifier: 117069920 to the API
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117069920?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fe6cbf6d-160b-50d6-903b-d4f3f982b2ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DS22PEO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117069920',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 17312,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DS22PEO/2025-11-19/image/0bcd0bca-6133-47d4-a183-26f3b86a79f7_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/43cf12de-3959-402a-b761-68eb29ffa732_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/316c1b8b-2a9e-4b15-9749-4590ab01cdc2_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/b1a83994-b5b8-45de-86fc-82e7c1d7666a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/450f5f19-8e80-4ef5-a90d-1aeb6564948f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/279f4c6e-df69-40b6-bae7-3d4a55e4ac39_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/796bca19-3647-4c10-a5b5-cbe546765034_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/d8edfa18-db52-4c66-8204-46690de044ba_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33457,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/0bcd0bca-6133-47d4-a183-26f3b86a79f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34633,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/43cf12de-3959-402a-b761-68eb29ffa732_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34319,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/316c1b8b-2a9e-4b15-9749-4590ab01cdc2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32788,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/b1a83994-b5b8-45de-86fc-82e7c1d7666a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49845,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/450f5f19-8e80-4ef5-a90d-1aeb6564948f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43081,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/279f4c6e-df69-40b6-bae7-3d4a55e4ac39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51335,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/796bca19-3647-4c10-a5b5-cbe546765034_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6cbf6d-160b-50d6-903b-d4f3f982b2ff/fe6cbf6d-160b-50d6-903b-d4f3f982b2ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46223,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS22PEO/2025-11-19/image/d8edfa18-db52-4c66-8204-46690de044ba_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Premium 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069920%27 HTTP/1.1" 200 None
2025-12-03 19:00:42 [astonbarclay.gb] INFO: Saving data for 117069920: {'created_time': 1764788442.642585, 'last_price_update_time': 1764788442.642596, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117069920') HTTP/1.1" 204 0
2025-12-03 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebea410>
2025-12-03 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebebcd0>
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252Fe79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/e79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117629259
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117629259%27 HTTP/1.1" 200 None
2025-12-03 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117629259: 1
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fb92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/b92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117442908?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1c6d0>
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252Facd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/acd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/b3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117195887?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117664657
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664657%27 HTTP/1.1" 200 None
2025-12-03 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117664657: 1
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec224d0>
2025-12-03 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117457472, 'registration': 'YB72AVY', 'account': 'THE109', 'make': 'BMW', 'model': '4 SERIES DIESEL COUPE', 'derivative': '420d MHT M Sport 2dr Step Auto [Pro Pack]', 'mileage': 26896, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T20:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2022-12-16', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 2, 'engineSize': 1995, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/YB72AVY/2025-11-28/image/fa1d6258-90ad-42ac-b0db-ca1a98e115eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/627cfb79-fa22-42eb-ab21-c09697979af1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/2415f488-540c-47a5-85ca-4087ef7574e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/7a248448-9741-4b6d-abef-586cda023e4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/e12f4222-8ade-46bd-8b48-a695379d96fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/2c7f8c4a-b5e0-4558-a857-15b474a8280a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/e1fee37b-8b2c-4c81-887c-03c54501a935_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/383b8f31-a1aa-4e61-bb8f-91bcd3c9495a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/73f81c90-9bd5-4d6d-a7aa-e7d294c5cb7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/0b331729-3bae-48a6-b695-588eb0a2cb34_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital iDRIVE 04/24 14K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4eaffeda-7376-4243-b8e1-ea0a0f85cbae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117457472, 'registration': 'YB72AVY', 'account': 'THE109', 'make': 'BMW', 'model': '4 SERIES DIESEL COUPE', 'derivative': '420d MHT M Sport 2dr Step Auto [Pro Pack]', 'mileage': 26896, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T20:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2022-12-16', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 2, 'engineSize': 1995, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/YB72AVY/2025-11-28/image/fa1d6258-90ad-42ac-b0db-ca1a98e115eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/627cfb79-fa22-42eb-ab21-c09697979af1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/2415f488-540c-47a5-85ca-4087ef7574e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/7a248448-9741-4b6d-abef-586cda023e4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/e12f4222-8ade-46bd-8b48-a695379d96fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/2c7f8c4a-b5e0-4558-a857-15b474a8280a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/e1fee37b-8b2c-4c81-887c-03c54501a935_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/383b8f31-a1aa-4e61-bb8f-91bcd3c9495a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/73f81c90-9bd5-4d6d-a7aa-e7d294c5cb7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB72AVY/2025-11-28/image/0b331729-3bae-48a6-b695-588eb0a2cb34_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital iDRIVE 04/24 14K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4eaffeda-7376-4243-b8e1-ea0a0f85cbae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c68d3261-86f0-5fcc-89c3-000794e4e07f with identifier: 117457472
2025-12-03 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c68d3261-86f0-5fcc-89c3-000794e4e07f with scrape type 2
2025-12-03 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c68d3261-86f0-5fcc-89c3-000794e4e07f with scrape type 2
2025-12-03 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c68d3261-86f0-5fcc-89c3-000794e4e07f, identifier: 117457472
2025-12-03 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c68d3261-86f0-5fcc-89c3-000794e4e07f with identifier: 117457472
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-03 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c68d3261-86f0-5fcc-89c3-000794e4e07f with identifier: 117457472
2025-12-03 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c68d3261-86f0-5fcc-89c3-000794e4e07f with identifier: 117457472 to the API
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c68d3261-86f0-5fcc-89c3-000794e4e07f%27 HTTP/1.1" 200 None
2025-12-03 19:00:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c68d3261-86f0-5fcc-89c3-000794e4e07f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117457472?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T20:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c68d3261-86f0-5fcc-89c3-000794e4e07f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB72AVY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117457472',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'BMW',
 'model': '4 SERIES DIESEL COUPE',
 'odometer': 26896,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seller_name': 'TCB Group - Prime',
 'title': 'BMW 4 SERIES DIESEL COUPE 420d MHT M Sport 2dr Step Auto [Pro Pack]',
 'transmission': 'automatic',
 'trim': '420d MHT M Sport 2dr Step Auto [Pro Pack]',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457472%27 HTTP/1.1" 200 None
2025-12-03 19:00:44 [astonbarclay.gb] INFO: Saving data for 117457472: {'auction_closing_time': 1764878400.0, 'created_time': 1764184068.540795, 'last_price_update_time': 1764788444.666893}
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117457472') HTTP/1.1" 204 0
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f79e910>
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e5e4710>
2025-12-03 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8a7610>
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f79c710>
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6f3510>
2025-12-03 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed540d0>
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117442908, 'registration': 'NV71WDJ', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE Edition 5dr', 'mileage': 29231, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T19:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'manual', 'firstRegistration': '2022-02-23', 'fuel': 'Petrol', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/137da4ca-0aa5-4367-aab6-3120062ec698_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/87b7b8a2-bcc1-429e-8ef4-fb93f1dcbd7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/9d6e9c93-e5de-46a7-8a11-43c7e6a23c3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/11e690d3-31fc-45e5-bafe-d1ffbf443f0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/73573935-a13f-4ba8-be16-a85e5e3bd442_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/3ae119f0-95ed-4da6-8de6-377efdff019e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/249fc4e4-8983-4710-8864-7d6ad2e29966_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/020c5739-226a-436c-ac71-8f8943a27303_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/97e84464-d1e0-4ac6-83f0-847b3f2494d6_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 01/24 - 15K, 01/25 - 22K OIL AND FILTER', 'remarks': '**483** VOSA STATES 22K', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1864a224-94e5-43d2-9314-4c414cff0998.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117442908, 'registration': 'NV71WDJ', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE Edition 5dr', 'mileage': 29231, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T19:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'manual', 'firstRegistration': '2022-02-23', 'fuel': 'Petrol', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/137da4ca-0aa5-4367-aab6-3120062ec698_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/87b7b8a2-bcc1-429e-8ef4-fb93f1dcbd7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/9d6e9c93-e5de-46a7-8a11-43c7e6a23c3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/11e690d3-31fc-45e5-bafe-d1ffbf443f0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/73573935-a13f-4ba8-be16-a85e5e3bd442_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/3ae119f0-95ed-4da6-8de6-377efdff019e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/249fc4e4-8983-4710-8864-7d6ad2e29966_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/020c5739-226a-436c-ac71-8f8943a27303_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV71WDJ/2025-11-24/image/97e84464-d1e0-4ac6-83f0-847b3f2494d6_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 01/24 - 15K, 01/25 - 22K OIL AND FILTER', 'remarks': '**483** VOSA STATES 22K', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1864a224-94e5-43d2-9314-4c414cff0998.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98622fde-0cbf-5567-b5bb-313f5ceb197c with identifier: 117442908
2025-12-03 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98622fde-0cbf-5567-b5bb-313f5ceb197c with scrape type 2
2025-12-03 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98622fde-0cbf-5567-b5bb-313f5ceb197c with scrape type 2
2025-12-03 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 98622fde-0cbf-5567-b5bb-313f5ceb197c, identifier: 117442908
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/c697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117617912
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117617912%27 HTTP/1.1" 200 None
2025-12-03 19:00:46 [astonbarclay.gb] INFO: Scrape type for 117617912: 1
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 98622fde-0cbf-5567-b5bb-313f5ceb197c with identifier: 117442908
2025-12-03 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 98622fde-0cbf-5567-b5bb-313f5ceb197c with identifier: 117442908
2025-12-03 19:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 98622fde-0cbf-5567-b5bb-313f5ceb197c with identifier: 117442908 to the API
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117442908?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T19:00:00Z',
 'fuel_type': 'Petrol',
 'id': '98622fde-0cbf-5567-b5bb-313f5ceb197c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NV71WDJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117442908',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 29231,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 SE Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442908%27 HTTP/1.1" 200 None
2025-12-03 19:00:46 [astonbarclay.gb] INFO: Saving data for 117442908: {'auction_closing_time': 1764874800.0, 'created_time': 1764010920.718697, 'last_price_update_time': 1764788446.818608}
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117442908') HTTP/1.1" 204 0
2025-12-03 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed0dc50>
2025-12-03 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fb3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/b3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117195887, 'registration': 'DV72JWA', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 13392, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 277, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72JWA/2025-11-19/image/e0f465a2-f405-4281-9dca-cba5a99faa04_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/fb79e204-c83d-4a02-b18f-a496bc751313_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/5c3a0136-ec37-4c9f-8bca-e98e5588c508_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/14b5c92a-2965-409a-8090-6d878985ae50_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/acfb72d5-e14c-4014-be5d-be21831e5536_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/29c5e9b0-2223-4941-8952-01ea60cf2652_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/bc47b331-873c-4044-8754-8201efbd89e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/6d2c2fa7-f673-4280-84f6-95c95f47bc29_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/24 6K 04/25 10K', 'remarks': 'VOSA STATES 12K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8af53f23-daff-4f6e-8131-db07ce5f28a5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117195887, 'registration': 'DV72JWA', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 13392, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 277, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72JWA/2025-11-19/image/e0f465a2-f405-4281-9dca-cba5a99faa04_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/fb79e204-c83d-4a02-b18f-a496bc751313_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/5c3a0136-ec37-4c9f-8bca-e98e5588c508_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/14b5c92a-2965-409a-8090-6d878985ae50_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/acfb72d5-e14c-4014-be5d-be21831e5536_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/29c5e9b0-2223-4941-8952-01ea60cf2652_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/bc47b331-873c-4044-8754-8201efbd89e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/6d2c2fa7-f673-4280-84f6-95c95f47bc29_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/24 6K 04/25 10K', 'remarks': 'VOSA STATES 12K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8af53f23-daff-4f6e-8131-db07ce5f28a5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0d6579-ef5d-50dc-a831-074020341d11 with identifier: 117195887
2025-12-03 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0d6579-ef5d-50dc-a831-074020341d11 with scrape type 1
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1b0d6579-ef5d-50dc-a831-074020341d11
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252Fe0f465a2-f405-4281-9dca-cba5a99faa04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/e0f465a2-f405-4281-9dca-cba5a99faa04_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252Ffb79e204-c83d-4a02-b18f-a496bc751313_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/fb79e204-c83d-4a02-b18f-a496bc751313_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252F5c3a0136-ec37-4c9f-8bca-e98e5588c508_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/5c3a0136-ec37-4c9f-8bca-e98e5588c508_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252F14b5c92a-2965-409a-8090-6d878985ae50_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/14b5c92a-2965-409a-8090-6d878985ae50_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252Facfb72d5-e14c-4014-be5d-be21831e5536_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/acfb72d5-e14c-4014-be5d-be21831e5536_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252F29c5e9b0-2223-4941-8952-01ea60cf2652_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/29c5e9b0-2223-4941-8952-01ea60cf2652_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252Fbc47b331-873c-4044-8754-8201efbd89e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/bc47b331-873c-4044-8754-8201efbd89e7_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72JWA%252F2025-11-19%252Fimage%252F6d2c2fa7-f673-4280-84f6-95c95f47bc29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72JWA/2025-11-19/image/6d2c2fa7-f673-4280-84f6-95c95f47bc29_removebg.jpg?w=600 already downloaded
2025-12-03 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1b0d6579-ef5d-50dc-a831-074020341d11, identifier: 117195887
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee95950>
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fe43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117448541
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117448541%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117448541: 0
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 116983938
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Scrape type for 116983938: 0
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117630789
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117630789%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117630789: 1
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fd576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/d576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117441149?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117441140?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1b0d6579-ef5d-50dc-a831-074020341d11 with identifier: 117195887
2025-12-03 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1b0d6579-ef5d-50dc-a831-074020341d11 with identifier: 117195887
2025-12-03 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1b0d6579-ef5d-50dc-a831-074020341d11 with identifier: 117195887 to the API
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117195887?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1b0d6579-ef5d-50dc-a831-074020341d11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DV72JWA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117195887',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 13392,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DV72JWA/2025-11-19/image/e0f465a2-f405-4281-9dca-cba5a99faa04_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/fb79e204-c83d-4a02-b18f-a496bc751313_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/5c3a0136-ec37-4c9f-8bca-e98e5588c508_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/14b5c92a-2965-409a-8090-6d878985ae50_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/acfb72d5-e14c-4014-be5d-be21831e5536_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/29c5e9b0-2223-4941-8952-01ea60cf2652_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/bc47b331-873c-4044-8754-8201efbd89e7_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/6d2c2fa7-f673-4280-84f6-95c95f47bc29_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32559,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/e0f465a2-f405-4281-9dca-cba5a99faa04_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32169,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/fb79e204-c83d-4a02-b18f-a496bc751313_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32238,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/5c3a0136-ec37-4c9f-8bca-e98e5588c508_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31503,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/14b5c92a-2965-409a-8090-6d878985ae50_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52139,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/acfb72d5-e14c-4014-be5d-be21831e5536_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45148,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/29c5e9b0-2223-4941-8952-01ea60cf2652_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54973,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/bc47b331-873c-4044-8754-8201efbd89e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0d6579-ef5d-50dc-a831-074020341d11/1b0d6579-ef5d-50dc-a831-074020341d11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47030,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72JWA/2025-11-19/image/6d2c2fa7-f673-4280-84f6-95c95f47bc29_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Premium 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195887%27 HTTP/1.1" 200 None
2025-12-03 19:00:47 [astonbarclay.gb] INFO: Saving data for 117195887: {'created_time': 1764788447.939948, 'last_price_update_time': 1764788447.939957, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195887') HTTP/1.1" 204 0
2025-12-03 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eeac110>
2025-12-03 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1f890>
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee29390>
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d7290>
2025-12-03 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee2af10>
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1fd90>
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fc697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/c697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee29a10>
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/b92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117183441
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183441%27 HTTP/1.1" 200 None
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117183441: 0
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117374089
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374089%27 HTTP/1.1" 200 None
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117374089: 0
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117555641
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117555641: 0
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117555034
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117555034: 0
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116489973
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116489973%27 HTTP/1.1" 200 None
2025-12-03 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116489973: 1
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fe3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed9f950>
2025-12-03 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/ff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679182?view=catalogue)
2025-12-03 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274570?view=catalogue)
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117441149, 'registration': 'YY23NVH', 'account': 'HAT002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr', 'mileage': 17212, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 117, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-05-04', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY23NVH/2025-11-25/image/cc1c67c3-a0f7-49d5-83d7-c21c752d84b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/5ca86b5f-035f-40e8-a37b-2fe981800e4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/0108ae0b-d3f9-417d-b238-13052686a2a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/f6764ac0-2cfc-46ae-bbd5-cc23205aac85_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/95ba9c6e-885a-4e8a-b33b-a9748e0286a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/d9e8fb5d-a874-4154-abae-a998c690c1cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/14fbbf53-6ce6-4ac8-a995-46d593f31a93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/64ff08ea-2daf-41d8-846a-1ab65ace6033_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/77fd887a-e6d8-4a01-be6b-e0a4b8444001_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/24- 7K, 05/25- 14K', 'remarks': '**18**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/02338e42-2aa6-47e6-86c6-5bb3ee2b0123.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117441149, 'registration': 'YY23NVH', 'account': 'HAT002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr', 'mileage': 17212, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 117, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-05-04', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY23NVH/2025-11-25/image/cc1c67c3-a0f7-49d5-83d7-c21c752d84b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/5ca86b5f-035f-40e8-a37b-2fe981800e4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/0108ae0b-d3f9-417d-b238-13052686a2a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/f6764ac0-2cfc-46ae-bbd5-cc23205aac85_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/95ba9c6e-885a-4e8a-b33b-a9748e0286a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/d9e8fb5d-a874-4154-abae-a998c690c1cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/14fbbf53-6ce6-4ac8-a995-46d593f31a93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/64ff08ea-2daf-41d8-846a-1ab65ace6033_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY23NVH/2025-11-25/image/77fd887a-e6d8-4a01-be6b-e0a4b8444001_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/24- 7K, 05/25- 14K', 'remarks': '**18**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/02338e42-2aa6-47e6-86c6-5bb3ee2b0123.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93be0f9a-d08e-50e3-be24-96cb847ceb30 with identifier: 117441149
2025-12-03 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93be0f9a-d08e-50e3-be24-96cb847ceb30 with scrape type 2
2025-12-03 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93be0f9a-d08e-50e3-be24-96cb847ceb30 with scrape type 2
2025-12-03 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 93be0f9a-d08e-50e3-be24-96cb847ceb30, identifier: 117441149
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117441140, 'registration': 'YC72LOH', 'account': 'HAT002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 23673, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 116, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC72LOH/2025-11-25/image/f3252602-f058-47a0-a07e-1ee2837e75ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/4711f480-9c6d-4436-82c1-f9df9e6fbedb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/7a09ab5b-b87b-41aa-a1ab-9f2240361b8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/8f90e1b6-a5ab-4c36-9e76-41d7aba73851_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/a3b8a7ee-5283-4c6d-a243-763b848e3584_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/ea64badc-c5c8-40bc-87bf-abdfc392be06_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/2a112912-704d-4aa2-9a44-df873f162834_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/322e2fe1-31c5-435e-aafc-60260499f754_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/c7f0fa20-a1f8-4f35-912a-c65537a80874_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23- 8K, 09/24- 15K,', 'remarks': '**38**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/72848029-a5a6-4a76-9411-a58ad078756e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117441140, 'registration': 'YC72LOH', 'account': 'HAT002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 23673, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 116, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC72LOH/2025-11-25/image/f3252602-f058-47a0-a07e-1ee2837e75ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/4711f480-9c6d-4436-82c1-f9df9e6fbedb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/7a09ab5b-b87b-41aa-a1ab-9f2240361b8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/8f90e1b6-a5ab-4c36-9e76-41d7aba73851_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/a3b8a7ee-5283-4c6d-a243-763b848e3584_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/ea64badc-c5c8-40bc-87bf-abdfc392be06_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/2a112912-704d-4aa2-9a44-df873f162834_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/322e2fe1-31c5-435e-aafc-60260499f754_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72LOH/2025-11-25/image/c7f0fa20-a1f8-4f35-912a-c65537a80874_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23- 8K, 09/24- 15K,', 'remarks': '**38**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/72848029-a5a6-4a76-9411-a58ad078756e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585a3db1-dca2-563f-ab98-17206e594e65 with identifier: 117441140
2025-12-03 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585a3db1-dca2-563f-ab98-17206e594e65 with scrape type 2
2025-12-03 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 585a3db1-dca2-563f-ab98-17206e594e65 with scrape type 2
2025-12-03 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 585a3db1-dca2-563f-ab98-17206e594e65, identifier: 117441140
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 115951209
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951209%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Scrape type for 115951209: 0
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 116163300
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116163300%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Scrape type for 116163300: 0
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 115951190
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951190%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Scrape type for 115951190: 0
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 115951329
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951329%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Scrape type for 115951329: 0
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 115951284
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951284%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Scrape type for 115951284: 0
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 117496386
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117496386%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Scrape type for 117496386: 2
2025-12-03 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 93be0f9a-d08e-50e3-be24-96cb847ceb30 with identifier: 117441149
2025-12-03 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 93be0f9a-d08e-50e3-be24-96cb847ceb30 with identifier: 117441149
2025-12-03 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 93be0f9a-d08e-50e3-be24-96cb847ceb30 with identifier: 117441149 to the API
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2793be0f9a-d08e-50e3-be24-96cb847ceb30%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 93be0f9a-d08e-50e3-be24-96cb847ceb30: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:50 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117441149?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '93be0f9a-d08e-50e3-be24-96cb847ceb30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY23NVH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117441149',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 17212,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-04',
 'seller_name': 'Hatfields Group',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '35 TFSI S Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441149%27 HTTP/1.1" 200 None
2025-12-03 19:00:50 [astonbarclay.gb] INFO: Saving data for 117441149: {'auction_closing_time': 1764927900.0, 'created_time': 1764010902.199802, 'last_price_update_time': 1764788450.889852}
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117441149') HTTP/1.1" 204 0
2025-12-03 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 585a3db1-dca2-563f-ab98-17206e594e65 with identifier: 117441140
2025-12-03 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 585a3db1-dca2-563f-ab98-17206e594e65 with identifier: 117441140
2025-12-03 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 585a3db1-dca2-563f-ab98-17206e594e65 with identifier: 117441140 to the API
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27585a3db1-dca2-563f-ab98-17206e594e65%27 HTTP/1.1" 200 None
2025-12-03 19:00:51 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 585a3db1-dca2-563f-ab98-17206e594e65: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:50 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117441140?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '585a3db1-dca2-563f-ab98-17206e594e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YC72LOH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117441140',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 23673,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seller_name': 'Hatfields Group',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Style 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Style 5dr',
 'vin': None,
 'year': 2022}
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441140%27 HTTP/1.1" 200 None
2025-12-03 19:00:51 [astonbarclay.gb] INFO: Saving data for 117441140: {'auction_closing_time': 1764927900.0, 'created_time': 1764010949.116686, 'last_price_update_time': 1764788451.298248}
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117441140') HTTP/1.1" 204 0
2025-12-03 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f793c50>
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fb92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/b92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/d576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 116419349
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-12-03 19:00:51 [astonbarclay.gb] INFO: Scrape type for 116419349: 2
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eeae310>
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebf14d0>
2025-12-03 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed65750>
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fa47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e1010>
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/ff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f9d53d0>
2025-12-03 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA67AVK%252F2025-12-02%252Fimage%252F2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3071479-531b-5073-80a0-213bea052820
2025-12-03 19:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3071479-531b-5073-80a0-213bea052820, skipping ID generation
2025-12-03 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3071479-531b-5073-80a0-213bea052820 with scrape type 1
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e3071479-531b-5073-80a0-213bea052820 from tracking dictionaries
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3071479-531b-5073-80a0-213bea052820 sending to next pipeline
2025-12-03 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e3071479-531b-5073-80a0-213bea052820, identifier: 117679182
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed5a110>
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM23UXO%252F2025-12-02%252Fimage%252F215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34
2025-12-03 19:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1deeafe-f91d-53d4-83e7-f5fe3b925a34, skipping ID generation
2025-12-03 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34 with scrape type 1
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1deeafe-f91d-53d4-83e7-f5fe3b925a34 from tracking dictionaries
2025-12-03 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1deeafe-f91d-53d4-83e7-f5fe3b925a34 sending to next pipeline
2025-12-03 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e1deeafe-f91d-53d4-83e7-f5fe3b925a34, identifier: 117274570
2025-12-03 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/a04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/d28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e3071479-531b-5073-80a0-213bea052820 with identifier: 117679182
2025-12-03 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e3071479-531b-5073-80a0-213bea052820 with identifier: 117679182
2025-12-03 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192132 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192132
2025-12-03 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e3071479-531b-5073-80a0-213bea052820 spider: astonbarclay.gb
2025-12-03 19:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e3071479-531b-5073-80a0-213bea052820 due to rule: high_mileage_for_country.json, error: 192132 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192132
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e3071479-531b-5073-80a0-213bea052820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA67AVK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117679182',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 119386,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37185,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/38f5309e-b881-4c56-85a4-7c99443ca7c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37712,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/acd8234b-794b-4bda-b2a5-ebf10179038a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41005,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2a9baaae-c3ed-43e1-a396-d08da99c0f25_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41960,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/5bbb2d65-b919-4d54-8424-435e440514d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65955,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/e79f393d-1c28-4fac-90e0-f57df7659526_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/2eea3199-38d1-471a-a3e7-99ebabc11207_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3071479-531b-5073-80a0-213bea052820/e3071479-531b-5073-80a0-213bea052820_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58898,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA67AVK/2025-12-02/image/294f0eee-e6b9-455d-a940-9157f9a2af44_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-14',
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 eD4 SE 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 eD4 SE 5dr 2WD',
 'vin': None,
 'year': 2017}
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679182%27 HTTP/1.1" 200 None
2025-12-03 19:00:53 [astonbarclay.gb] INFO: Saving data for 117679182: {'created_time': 1764788453.81832, 'last_price_update_time': 1764788453.81833, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117679182') HTTP/1.1" 204 0
2025-12-03 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e1deeafe-f91d-53d4-83e7-f5fe3b925a34 with identifier: 117274570
2025-12-03 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e1deeafe-f91d-53d4-83e7-f5fe3b925a34 with identifier: 117274570
2025-12-03 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q8 e-tron sportback 250kw 50 quattro 95kwh sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q8 e-tron sportback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 25701, 'odometer_reading_unit': 'mi', 'registration_date': '2023-06-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274570', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '250kw 50 quattro 95kwh sport 5dr auto', 'license_plate': 'mm23uxo', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e1deeafe-f91d-53d4-83e7-f5fe3b925a34', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35436}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50763}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60577}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57614}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57811}], 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'audi q8 e-tron sportback', 'sanitized_make': 'audi', 'odometer_in_km': 41361} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'e1deeafe-f91d-53d4-83e7-f5fe3b925a34',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'mm23uxo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274570',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q8 e-tron sportback',
     'model': 'q8 e-tron sportback',
     'odometer': 25701,
     'odometer_in_km': 41361,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35436,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35734,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34482,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33406,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50763,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60577,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57614,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57811,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-06-23',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q8 e-tron sportback 250kw 50 quattro 95kwh sport 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '250kw 50 quattro 95kwh sport 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-03 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: e1deeafe-f91d-53d4-83e7-f5fe3b925a34 spider: astonbarclay.gb
2025-12-03 19:00:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e1deeafe-f91d-53d4-83e7-f5fe3b925a34 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q8 e-tron sportback 250kw 50 quattro 95kwh sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q8 e-tron sportback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 25701, 'odometer_reading_unit': 'mi', 'registration_date': '2023-06-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274570', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '250kw 50 quattro 95kwh sport 5dr auto', 'license_plate': 'mm23uxo', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e1deeafe-f91d-53d4-83e7-f5fe3b925a34', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35436}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50763}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60577}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57614}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57811}], 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'audi q8 e-tron sportback', 'sanitized_make': 'audi', 'odometer_in_km': 41361} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'e1deeafe-f91d-53d4-83e7-f5fe3b925a34',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'mm23uxo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274570',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q8 e-tron sportback',
     'model': 'q8 e-tron sportback',
     'odometer': 25701,
     'odometer_in_km': 41361,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35436,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35734,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34482,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33406,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50763,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60577,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57614,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57811,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-06-23',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q8 e-tron sportback 250kw 50 quattro 95kwh sport 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '250kw 50 quattro 95kwh sport 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'e1deeafe-f91d-53d4-83e7-f5fe3b925a34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MM23UXO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274570',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'Q8 E-TRON SPORTBACK',
 'odometer': 25701,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35436,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2460eb90-7e7c-4327-b701-073150ec6122_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35734,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/4ad7f53d-0de7-414c-b167-a59bd994b479_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34482,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/79af5692-622a-4e3c-973a-fc238283b515_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33406,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/2fb897e5-6e2f-49d3-a8e4-dd3fec391c45_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50763,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/9e636f22-a4b6-4cd1-b5ad-a0c48d4f55cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60577,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/952b51b2-b863-41bf-ac0d-dfc9ea184c0c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57614,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/129e4594-ee37-4e5a-a130-4ec8f9903d1f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1deeafe-f91d-53d4-83e7-f5fe3b925a34/e1deeafe-f91d-53d4-83e7-f5fe3b925a34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57811,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM23UXO/2025-12-02/image/215ea79d-3cf6-414f-8144-7c716fa117b1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-23',
 'seller_name': 'Zenith',
 'title': 'AUDI Q8 E-TRON SPORTBACK 250kW 50 Quattro 95kWh Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': '250kW 50 Quattro 95kWh Sport 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274570%27 HTTP/1.1" 200 None
2025-12-03 19:00:54 [astonbarclay.gb] INFO: Saving data for 117274570: {'created_time': 1764788454.056627, 'last_price_update_time': 1764788454.056637, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117274570') HTTP/1.1" 204 0
2025-12-03 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117488530
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488530%27 HTTP/1.1" 200 None
2025-12-03 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117488530: 2
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e77d0>
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252F22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708065?view=catalogue)
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117253439?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6f1d10>
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_13.jpg HTTP/1.1" 201 0
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fd576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/d576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117581980
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-03 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117581980: 2
2025-12-03 19:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117629259?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117441346?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117617912?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117441244?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117572022?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebfda50>
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fa04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/a04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebff750>
2025-12-03 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fa75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff2ff50>
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252Fd28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/d28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117144969
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144969%27 HTTP/1.1" 200 None
2025-12-03 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117144969: 2
2025-12-03 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e1b90>
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_14.jpg HTTP/1.1" 201 0
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX66YGY%252F2025-12-03%252Fimage%252Fe3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5badee97-f25c-55a4-bd93-27232c1c81ef
2025-12-03 19:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5badee97-f25c-55a4-bd93-27232c1c81ef, skipping ID generation
2025-12-03 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5badee97-f25c-55a4-bd93-27232c1c81ef with scrape type 1
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5badee97-f25c-55a4-bd93-27232c1c81ef from tracking dictionaries
2025-12-03 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5badee97-f25c-55a4-bd93-27232c1c81ef sending to next pipeline
2025-12-03 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5badee97-f25c-55a4-bd93-27232c1c81ef, identifier: 117708065
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117664657, 'registration': 'NU20UYT', 'account': 'VAN040', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.6 CRDi 48V MHD SE Nav 5dr 2WD', 'mileage': 59388, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-06-26', 'fuel': 'Diesel', 'motExpiry': '2026-10-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg?w=600', 'https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600', 'https://abimg002.imgix.net/e3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg?w=600', 'https://abimg002.imgix.net/da8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg?w=600', 'https://abimg002.imgix.net/9096e418-08e9-4699-acbe-d1897d9b14c9.jpg?w=600', 'https://abimg002.imgix.net/52fefe97-9e50-4cc0-a244-e10c4de30595.jpg?w=600', 'https://abimg002.imgix.net/a9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg?w=600', 'https://abimg002.imgix.net/a8c5f7ca-208d-4818-9429-5dbf86471457.jpg?w=600', 'https://abimg002.imgix.net/88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg?w=600', 'https://abimg002.imgix.net/21f49de6-bf33-45a6-9e1d-8371366083bb.jpg?w=600', 'https://abimg002.imgix.net/95fb8986-5784-41e1-9f99-794d3d359f62.jpg?w=600', 'https://abimg002.imgix.net/de2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg?w=600', 'https://abimg002.imgix.net/b35a8b51-d556-468e-9bf7-a580fe189445.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K, 30K, 46K, 58K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117664657, 'registration': 'NU20UYT', 'account': 'VAN040', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.6 CRDi 48V MHD SE Nav 5dr 2WD', 'mileage': 59388, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-06-26', 'fuel': 'Diesel', 'motExpiry': '2026-10-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg?w=600', 'https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600', 'https://abimg002.imgix.net/e3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg?w=600', 'https://abimg002.imgix.net/da8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg?w=600', 'https://abimg002.imgix.net/9096e418-08e9-4699-acbe-d1897d9b14c9.jpg?w=600', 'https://abimg002.imgix.net/52fefe97-9e50-4cc0-a244-e10c4de30595.jpg?w=600', 'https://abimg002.imgix.net/a9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg?w=600', 'https://abimg002.imgix.net/a8c5f7ca-208d-4818-9429-5dbf86471457.jpg?w=600', 'https://abimg002.imgix.net/88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg?w=600', 'https://abimg002.imgix.net/21f49de6-bf33-45a6-9e1d-8371366083bb.jpg?w=600', 'https://abimg002.imgix.net/95fb8986-5784-41e1-9f99-794d3d359f62.jpg?w=600', 'https://abimg002.imgix.net/de2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg?w=600', 'https://abimg002.imgix.net/b35a8b51-d556-468e-9bf7-a580fe189445.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K, 30K, 46K, 58K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bcbb47e-c032-5cf4-8efa-1d62257ff461 with identifier: 117664657
2025-12-03 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461 with scrape type 1
2025-12-03 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg?w=600 not downloaded yet
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117253439, 'registration': 'SP68GDZ', 'account': 'AST058', 'make': 'VOLVO', 'model': 'V40 HATCHBACK', 'derivative': 'T3 [152] Inscription 5dr Geartronic', 'mileage': 21121, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 126, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-10-12', 'fuel': 'Petrol', 'motExpiry': '2026-10-31', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/73d8bc71-edf0-410a-bc2c-4ebe4ec9034d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/bd22d5d9-fef7-464b-8953-cc4f6d5ead55_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/fde1b846-7d22-46e1-907e-fab545e79842_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/81fb0025-fa18-44a0-857c-c6ce41d965da_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/4f3c09e7-86dd-4916-b0a9-8e0addc0c868_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/334165e7-ac47-49dd-83dc-c7e530b44238_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/b263343f-c094-4cea-aaa3-a59d1238da76_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/75f4d7e1-2030-4931-87d9-106c4aaa180c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/8429c19f-43aa-4d4f-8331-f90922488d99_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/19 - 5K, 09/20 - 9K, 12/21 - 14K, 11/22 - 16K, 10/23 - 18K, 10/24 - 20K', 'remarks': '**1833** VOSA STATES 14K, 16K, 18K, 20K, 21K', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/54aa5160-a793-4d44-aa04-909259280a1d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117253439, 'registration': 'SP68GDZ', 'account': 'AST058', 'make': 'VOLVO', 'model': 'V40 HATCHBACK', 'derivative': 'T3 [152] Inscription 5dr Geartronic', 'mileage': 21121, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 126, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-10-12', 'fuel': 'Petrol', 'motExpiry': '2026-10-31', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/73d8bc71-edf0-410a-bc2c-4ebe4ec9034d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/bd22d5d9-fef7-464b-8953-cc4f6d5ead55_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/fde1b846-7d22-46e1-907e-fab545e79842_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/81fb0025-fa18-44a0-857c-c6ce41d965da_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/4f3c09e7-86dd-4916-b0a9-8e0addc0c868_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/334165e7-ac47-49dd-83dc-c7e530b44238_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/b263343f-c094-4cea-aaa3-a59d1238da76_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/75f4d7e1-2030-4931-87d9-106c4aaa180c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SP68GDZ/2025-11-17/image/8429c19f-43aa-4d4f-8331-f90922488d99_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/19 - 5K, 09/20 - 9K, 12/21 - 14K, 11/22 - 16K, 10/23 - 18K, 10/24 - 20K', 'remarks': '**1833** VOSA STATES 14K, 16K, 18K, 20K, 21K', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/54aa5160-a793-4d44-aa04-909259280a1d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a197713-154c-5a1f-a80a-706a8f1bd297 with identifier: 117253439
2025-12-03 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a197713-154c-5a1f-a80a-706a8f1bd297 with scrape type 2
2025-12-03 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a197713-154c-5a1f-a80a-706a8f1bd297 with scrape type 2
2025-12-03 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7a197713-154c-5a1f-a80a-706a8f1bd297, identifier: 117253439
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117479539
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479539%27 HTTP/1.1" 200 None
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117479539: 2
2025-12-03 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117441190?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5badee97-f25c-55a4-bd93-27232c1c81ef with identifier: 117708065
2025-12-03 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5badee97-f25c-55a4-bd93-27232c1c81ef with identifier: 117708065
2025-12-03 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5badee97-f25c-55a4-bd93-27232c1c81ef with identifier: 117708065 to the API
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5badee97-f25c-55a4-bd93-27232c1c81ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PX66YGY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708065',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 86224,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31785,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/fe81cf96-9fee-4e25-b1c7-5e67b6a6fe72_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31550,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a75d44a8-52d6-4bdd-a0e1-c743695cefee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30022,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/a47425a6-1174-4d6a-b3ba-815c9a2ee9c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29431,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/23ef6284-b37f-48c5-810b-4b03e6ac569c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35403,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e43718d2-ef25-48d4-a0b3-5b5e930ace82_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52002,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/3b9127aa-19cd-4243-8d3d-a7d98fe9dc0a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52612,
             'Height': 797,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/11f4bdf6-c716-4e73-b9c8-db838bf4f9b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52819,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/2bbf5a69-a592-4437-89b1-e6f945948247_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52029,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/5cee2ce1-0cce-4086-ada2-bf55e099ed32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39453,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/c697387e-54e4-4bff-8b7f-5c97288288a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29572,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/b92fdcee-629a-42ae-b260-fae1e0f87604_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60236,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/6e76913f-3c41-4b7a-894d-0ed0de56e05c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38551,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/22361447-ae8f-49b9-9721-f0b945aa9978_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57540,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/d576afcd-5e85-4a22-bfb3-2164faa53dc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5badee97-f25c-55a4-bd93-27232c1c81ef/5badee97-f25c-55a4-bd93-27232c1c81ef_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54376,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX66YGY/2025-12-03/image/e3df7997-caa8-4296-9e21-c156397f83c4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-07',
 'seller_name': None,
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708065%27 HTTP/1.1" 200 None
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Saving data for 117708065: {'created_time': 1764788456.58709, 'last_price_update_time': 1764788456.587099, 'auction_closing_time': 1764842400.0}
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117708065') HTTP/1.1" 204 0
2025-12-03 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7a197713-154c-5a1f-a80a-706a8f1bd297 with identifier: 117253439
2025-12-03 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7a197713-154c-5a1f-a80a-706a8f1bd297 with identifier: 117253439
2025-12-03 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7a197713-154c-5a1f-a80a-706a8f1bd297 with identifier: 117253439 to the API
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117253439?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7a197713-154c-5a1f-a80a-706a8f1bd297',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SP68GDZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117253439',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'V40 HATCHBACK',
 'odometer': 21121,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-12',
 'seller_name': 'LDG',
 'title': 'VOLVO V40 HATCHBACK T3 [152] Inscription 5dr Geartronic',
 'transmission': 'automatic',
 'trim': 'T3 [152] Inscription 5dr Geartronic',
 'vin': None,
 'year': 2018}
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253439%27 HTTP/1.1" 200 None
2025-12-03 19:00:56 [astonbarclay.gb] INFO: Saving data for 117253439: {'auction_closing_time': 1764927900.0, 'created_time': 1763406205.771007, 'last_price_update_time': 1764788456.879017}
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117253439') HTTP/1.1" 204 0
2025-12-03 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e15d0>
2025-12-03 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee39250>
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117629259, 'registration': 'LL18LZF', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ALLSPACE DIESEL ESTATE', 'derivative': '2.0 TDI SE Nav 5dr', 'mileage': 63895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 27K, 28K, 35K, 45K, 54K, 63K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117629259, 'registration': 'LL18LZF', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ALLSPACE DIESEL ESTATE', 'derivative': '2.0 TDI SE Nav 5dr', 'mileage': 63895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 27K, 28K, 35K, 45K, 54K, 63K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f680865d-51e0-5a28-8772-54018579317f with identifier: 117629259
2025-12-03 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f680865d-51e0-5a28-8772-54018579317f with scrape type 1
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f680865d-51e0-5a28-8772-54018579317f
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f680865d-51e0-5a28-8772-54018579317f
2025-12-03 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f680865d-51e0-5a28-8772-54018579317f, identifier: 117629259
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117441346, 'registration': 'MC24OKW', 'account': 'HAT007', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e Sport 4dr Step Auto', 'mileage': 13145, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 111, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-06-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MC24OKW/2025-11-26/image/2ebb12e7-803a-4e15-a9ad-0822d9c1148e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/ee00cfaa-d66b-4122-b40c-16476590ea39_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/676f6843-50cb-4c89-ba3d-ddbc98e3101f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/4c0cac48-8bed-4fdd-8fa0-dfa648ec02d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/4141a934-c542-4640-80ae-e7d4d79baa4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/2d0e7dc6-858e-4bba-9b18-afe25b264042_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/3cb55373-29c9-412a-8bd8-5a808d659503_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/c2f9e973-14d7-4a38-a0ad-619ab1e543ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/0cfaf6ef-c9ac-44e8-8b40-a3cfa4f308d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/ad20d49c-ddf9-4b3b-ba7e-f361e73d5bb6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**44** CHARGING CABLE', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/99424342-274f-4cbb-9e7a-d4961022bfdc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117441346, 'registration': 'MC24OKW', 'account': 'HAT007', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e Sport 4dr Step Auto', 'mileage': 13145, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 111, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-06-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MC24OKW/2025-11-26/image/2ebb12e7-803a-4e15-a9ad-0822d9c1148e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/ee00cfaa-d66b-4122-b40c-16476590ea39_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/676f6843-50cb-4c89-ba3d-ddbc98e3101f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/4c0cac48-8bed-4fdd-8fa0-dfa648ec02d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/4141a934-c542-4640-80ae-e7d4d79baa4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/2d0e7dc6-858e-4bba-9b18-afe25b264042_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/3cb55373-29c9-412a-8bd8-5a808d659503_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/c2f9e973-14d7-4a38-a0ad-619ab1e543ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/0cfaf6ef-c9ac-44e8-8b40-a3cfa4f308d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC24OKW/2025-11-26/image/ad20d49c-ddf9-4b3b-ba7e-f361e73d5bb6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**44** CHARGING CABLE', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/99424342-274f-4cbb-9e7a-d4961022bfdc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59896ad6-68eb-50b1-8fc8-459e75d5f751 with identifier: 117441346
2025-12-03 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59896ad6-68eb-50b1-8fc8-459e75d5f751 with scrape type 2
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59896ad6-68eb-50b1-8fc8-459e75d5f751 with scrape type 2
2025-12-03 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 59896ad6-68eb-50b1-8fc8-459e75d5f751, identifier: 117441346
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117617912, 'registration': 'PN20SBX', 'account': 'VAN046', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 MPi Premium 5dr', 'mileage': 29866, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-06-09', 'fuel': 'Petrol', 'motExpiry': '2026-06-08', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/c1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg?w=600', 'https://abimg002.imgix.net/4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg?w=600', 'https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 17K, 23K, 27K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117617912, 'registration': 'PN20SBX', 'account': 'VAN046', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 MPi Premium 5dr', 'mileage': 29866, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-06-09', 'fuel': 'Petrol', 'motExpiry': '2026-06-08', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/c1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg?w=600', 'https://abimg002.imgix.net/4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg?w=600', 'https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 17K, 23K, 27K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7254ec63-695f-5f26-8ded-0de20ccd1515 with identifier: 117617912
2025-12-03 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7254ec63-695f-5f26-8ded-0de20ccd1515 with scrape type 1
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item 7254ec63-695f-5f26-8ded-0de20ccd1515
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg?w=600 not downloaded yet
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117441244, 'registration': 'DA69DRO', 'account': 'HAT007', 'make': 'LEXUS', 'model': 'UX HATCHBACK', 'derivative': '250h 2.0 F-Sport 5dr CVT [Nav]', 'mileage': 59283, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 113, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-14', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2025-11-13', 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DA69DRO/2025-11-28/image/94c61315-3eb1-4d15-9ce2-c1806416b6a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/4d30149f-3130-414a-b0fd-75a86292d05a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/b9b3dd18-c3e6-450c-8eba-1f6dc2ddfe87_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/06912a00-82a4-4824-98b1-e0cae5edecb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/af16b139-1bcf-4c15-bf4a-b6a503ee09c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/9f705e52-aa93-4287-a55b-7616b9ac1575_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/5510eb18-f0ec-4244-88b3-fad6990eb888_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/f2d2ee31-dfe9-4897-9c32-400bfe5e6a09_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/67b818d6-0799-4ae5-99e9-c31411b5b2fd_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/21- 10K, 12/22- 18K', 'remarks': '**6**VOSA STATES 16K, 28K, 38K, 59K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/050b686c-f15a-427d-97a3-258817dff51f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117441244, 'registration': 'DA69DRO', 'account': 'HAT007', 'make': 'LEXUS', 'model': 'UX HATCHBACK', 'derivative': '250h 2.0 F-Sport 5dr CVT [Nav]', 'mileage': 59283, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 113, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-14', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2025-11-13', 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DA69DRO/2025-11-28/image/94c61315-3eb1-4d15-9ce2-c1806416b6a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/4d30149f-3130-414a-b0fd-75a86292d05a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/b9b3dd18-c3e6-450c-8eba-1f6dc2ddfe87_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/06912a00-82a4-4824-98b1-e0cae5edecb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/af16b139-1bcf-4c15-bf4a-b6a503ee09c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/9f705e52-aa93-4287-a55b-7616b9ac1575_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/5510eb18-f0ec-4244-88b3-fad6990eb888_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/f2d2ee31-dfe9-4897-9c32-400bfe5e6a09_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA69DRO/2025-11-28/image/67b818d6-0799-4ae5-99e9-c31411b5b2fd_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/21- 10K, 12/22- 18K', 'remarks': '**6**VOSA STATES 16K, 28K, 38K, 59K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/050b686c-f15a-427d-97a3-258817dff51f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e576b26-1f0a-59ed-9178-76688a12bb9f with identifier: 117441244
2025-12-03 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e576b26-1f0a-59ed-9178-76688a12bb9f with scrape type 2
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e576b26-1f0a-59ed-9178-76688a12bb9f with scrape type 2
2025-12-03 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e576b26-1f0a-59ed-9178-76688a12bb9f, identifier: 117441244
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117572022, 'registration': 'YF21WWL', 'account': 'SPR003', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD', 'mileage': 54055, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 120, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-17', 'fuel': 'Diesel', 'motExpiry': '2026-03-16', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF21WWL/2025-11-28/image/6b5ffac8-6c89-4b8c-ab25-6672d9c0c5cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/394afe52-a59a-4307-b5b3-933eac5784b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/77c089eb-1235-4f3b-9030-37affdeb6ad2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/b13cd85f-a106-454a-83d5-c73fdcf5799e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/dcda9db5-a622-4e3b-9322-7abbb397de16_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/7c87de94-a535-424f-a60d-102a2c9bc373_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/3f312796-dc46-45ef-806d-aa14b61bef8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/f282de87-dcb0-4be1-8a00-1c146c898ba5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/8987cbb4-1cb1-42fa-b47c-c5f56e3bc6ba_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22 - 17K, 11/25 - 53K', 'remarks': '**617**VOSA STATES 32K, 45K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a6ec542-62ce-483a-a1a0-0ce92579eb5f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117572022, 'registration': 'YF21WWL', 'account': 'SPR003', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD', 'mileage': 54055, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 120, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-17', 'fuel': 'Diesel', 'motExpiry': '2026-03-16', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF21WWL/2025-11-28/image/6b5ffac8-6c89-4b8c-ab25-6672d9c0c5cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/394afe52-a59a-4307-b5b3-933eac5784b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/77c089eb-1235-4f3b-9030-37affdeb6ad2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/b13cd85f-a106-454a-83d5-c73fdcf5799e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/dcda9db5-a622-4e3b-9322-7abbb397de16_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/7c87de94-a535-424f-a60d-102a2c9bc373_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/3f312796-dc46-45ef-806d-aa14b61bef8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/f282de87-dcb0-4be1-8a00-1c146c898ba5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/8987cbb4-1cb1-42fa-b47c-c5f56e3bc6ba_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22 - 17K, 11/25 - 53K', 'remarks': '**617**VOSA STATES 32K, 45K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a6ec542-62ce-483a-a1a0-0ce92579eb5f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022
2025-12-03 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with scrape type 2
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with scrape type 2
2025-12-03 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193, identifier: 117572022
2025-12-03 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117425658?view=catalogue)
2025-12-03 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F97a4618d-9250-4588-8f85-208eb59f8d2c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600 not downloaded yet
2025-12-03 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f680865d-51e0-5a28-8772-54018579317f with identifier: 117629259
2025-12-03 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f680865d-51e0-5a28-8772-54018579317f with identifier: 117629259
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f680865d-51e0-5a28-8772-54018579317f with identifier: 117629259 to the API
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f680865d-51e0-5a28-8772-54018579317f%27 HTTP/1.1" 200 None
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f680865d-51e0-5a28-8772-54018579317f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117629259?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'f680865d-51e0-5a28-8772-54018579317f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL18LZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117629259',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE DIESEL ESTATE',
 'odometer': 63895,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-25',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE DIESEL ESTATE 2.0 TDI SE Nav 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI SE Nav 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117629259%27 HTTP/1.1" 200 None
2025-12-03 19:00:58 [astonbarclay.gb] INFO: Saving data for 117629259: {'created_time': 1764788458.203112, 'last_price_update_time': 1764788458.203123, 'auction_closing_time': 1764927900.0}
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117629259') HTTP/1.1" 204 0
2025-12-03 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 59896ad6-68eb-50b1-8fc8-459e75d5f751 with identifier: 117441346
2025-12-03 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 59896ad6-68eb-50b1-8fc8-459e75d5f751 with identifier: 117441346
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 59896ad6-68eb-50b1-8fc8-459e75d5f751 with identifier: 117441346 to the API
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2759896ad6-68eb-50b1-8fc8-459e75d5f751%27 HTTP/1.1" 200 None
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 59896ad6-68eb-50b1-8fc8-459e75d5f751: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117441346?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '59896ad6-68eb-50b1-8fc8-459e75d5f751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MC24OKW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117441346',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 13145,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-28',
 'seller_name': 'Hatfields Group',
 'title': 'BMW 3 SERIES SALOON 330e Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e Sport 4dr Step Auto',
 'vin': None,
 'year': 2024}
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441346%27 HTTP/1.1" 200 None
2025-12-03 19:00:58 [astonbarclay.gb] INFO: Saving data for 117441346: {'auction_closing_time': 1764927900.0, 'created_time': 1764010926.822552, 'last_price_update_time': 1764788458.508817}
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117441346') HTTP/1.1" 204 0
2025-12-03 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e576b26-1f0a-59ed-9178-76688a12bb9f with identifier: 117441244
2025-12-03 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e576b26-1f0a-59ed-9178-76688a12bb9f with identifier: 117441244
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9e576b26-1f0a-59ed-9178-76688a12bb9f with identifier: 117441244 to the API
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279e576b26-1f0a-59ed-9178-76688a12bb9f%27 HTTP/1.1" 200 None
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9e576b26-1f0a-59ed-9178-76688a12bb9f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117441244?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '9e576b26-1f0a-59ed-9178-76688a12bb9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA69DRO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117441244',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LEXUS',
 'model': 'UX HATCHBACK',
 'odometer': 59283,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': 'Hatfields Group',
 'title': 'LEXUS UX HATCHBACK 250h 2.0 F-Sport 5dr CVT [Nav]',
 'transmission': 'automatic',
 'trim': '250h 2.0 F-Sport 5dr CVT [Nav]',
 'vin': None,
 'year': 2019}
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441244%27 HTTP/1.1" 200 None
2025-12-03 19:00:58 [astonbarclay.gb] INFO: Saving data for 117441244: {'auction_closing_time': 1764927900.0, 'created_time': 1764010903.604665, 'last_price_update_time': 1764788458.785495}
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117441244') HTTP/1.1" 204 0
2025-12-03 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022
2025-12-03 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022
2025-12-03 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022 to the API
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117572022?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '0906a1b6-7b1a-50a4-bcd4-6c0591e2d193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YF21WWL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117572022',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 54055,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': 'Ford Main Dealer',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 EcoBlue 190 ST-Line X Edition 5dr Auto '
          'AWD',
 'transmission': 'automatic',
 'trim': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD',
 'vin': None,
 'year': 2021}
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572022%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Saving data for 117572022: {'auction_closing_time': 1764927900.0, 'created_time': 1764356608.714095, 'last_price_update_time': 1764788459.095561}
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117572022') HTTP/1.1" 204 0
2025-12-03 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117117971
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117117971%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117117971: 0
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117420392
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420392%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117420392: 0
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117599215
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599215%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117599215: 0
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 115422003
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115422003%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Scrape type for 115422003: 0
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117701765
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117701765%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117701765: 1
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg?w=600 not downloaded yet
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg?w=600 not downloaded yet
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117681911
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681911%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117681911: 1
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600 not downloaded yet
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117441190, 'registration': 'PK20ATX', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D150 S 5dr 2WD', 'mileage': 19914, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 118, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-03-13', 'fuel': 'Diesel', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PK20ATX/2025-11-28/image/e1e7d70a-bc8c-40b6-bb60-d592bcbeab40_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/d4c20594-750d-432c-bcef-97d0a5df4203_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/c9041074-c97f-445e-a8e9-caeaf68f7da0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/a4b6deae-ebba-4b0f-b820-cb0bca83b1d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/89895d21-9e96-4dae-a791-abf09028f1e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/122597a7-90b8-403f-b493-8ad65c996637_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/0f3d4fee-fc14-4429-aae1-03aef2f49091_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/390a542c-381f-404f-8cf6-4a5dbee293c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/304dd295-d6d9-463c-a1bd-ca2fc1ea3d75_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/23- 10K, 12/24- 16K', 'remarks': '**105**VOSA STATES 10K, 13K, 16K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6967e1ee-2618-4e9c-8f21-41d31ed2d740.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117441190, 'registration': 'PK20ATX', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 D150 S 5dr 2WD', 'mileage': 19914, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 118, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-03-13', 'fuel': 'Diesel', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PK20ATX/2025-11-28/image/e1e7d70a-bc8c-40b6-bb60-d592bcbeab40_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/d4c20594-750d-432c-bcef-97d0a5df4203_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/c9041074-c97f-445e-a8e9-caeaf68f7da0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/a4b6deae-ebba-4b0f-b820-cb0bca83b1d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/89895d21-9e96-4dae-a791-abf09028f1e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/122597a7-90b8-403f-b493-8ad65c996637_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/0f3d4fee-fc14-4429-aae1-03aef2f49091_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/390a542c-381f-404f-8cf6-4a5dbee293c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK20ATX/2025-11-28/image/304dd295-d6d9-463c-a1bd-ca2fc1ea3d75_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/23- 10K, 12/24- 16K', 'remarks': '**105**VOSA STATES 10K, 13K, 16K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6967e1ee-2618-4e9c-8f21-41d31ed2d740.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8204bce4-8df7-5cf8-8cdc-e06dab56bebf with identifier: 117441190
2025-12-03 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8204bce4-8df7-5cf8-8cdc-e06dab56bebf with scrape type 2
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8204bce4-8df7-5cf8-8cdc-e06dab56bebf with scrape type 2
2025-12-03 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8204bce4-8df7-5cf8-8cdc-e06dab56bebf, identifier: 117441190
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec315d0>
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAJ22KKR%252F2025-12-02%252Fimage%252F95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600 saved to cache
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b
2025-12-03 19:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d46ec03-77a7-5e80-a555-d91c9137ef7b, skipping ID generation
2025-12-03 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b with scrape type 1
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8d46ec03-77a7-5e80-a555-d91c9137ef7b from tracking dictionaries
2025-12-03 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d46ec03-77a7-5e80-a555-d91c9137ef7b sending to next pipeline
2025-12-03 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d46ec03-77a7-5e80-a555-d91c9137ef7b, identifier: 117425658
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee66650>
2025-12-03 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Ffcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fda8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/da8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg?w=600 not downloaded yet
2025-12-03 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8204bce4-8df7-5cf8-8cdc-e06dab56bebf with identifier: 117441190
2025-12-03 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8204bce4-8df7-5cf8-8cdc-e06dab56bebf with identifier: 117441190
2025-12-03 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8204bce4-8df7-5cf8-8cdc-e06dab56bebf with identifier: 117441190 to the API
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278204bce4-8df7-5cf8-8cdc-e06dab56bebf%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8204bce4-8df7-5cf8-8cdc-e06dab56bebf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:00:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117441190?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '8204bce4-8df7-5cf8-8cdc-e06dab56bebf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PK20ATX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117441190',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 19914,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-13',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 D150 S 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 D150 S 5dr 2WD',
 'vin': None,
 'year': 2020}
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441190%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Saving data for 117441190: {'auction_closing_time': 1764927900.0, 'created_time': 1764010913.793594, 'last_price_update_time': 1764788460.37054}
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117441190') HTTP/1.1" 204 0
2025-12-03 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d46ec03-77a7-5e80-a555-d91c9137ef7b with identifier: 117425658
2025-12-03 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d46ec03-77a7-5e80-a555-d91c9137ef7b with identifier: 117425658
2025-12-03 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8d46ec03-77a7-5e80-a555-d91c9137ef7b with identifier: 117425658 to the API
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '8d46ec03-77a7-5e80-a555-d91c9137ef7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AJ22KKR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117425658',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TESLA',
 'model': 'MODEL Y HATCHBACK',
 'odometer': 23477,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22131,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/95e90eab-acf9-44f6-9708-d8b84115c44b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23349,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/935d6493-aacb-4583-a5e3-dd90f39c6ee3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23302,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/d28b5c8f-6aaf-4b03-ae6e-743465455b17_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21337,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/a04e8404-6848-4490-abf9-a46e739e9b34_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32843,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/6cc391fd-9edd-49aa-81cf-42bb0c75853a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34012,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/ff0b2dde-3e0b-4690-941b-06af9a84a674_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44717,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/26536a42-48fd-4488-89bf-8442e3262b9a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d46ec03-77a7-5e80-a555-d91c9137ef7b/8d46ec03-77a7-5e80-a555-d91c9137ef7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39871,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AJ22KKR/2025-12-02/image/b3bc182b-9807-43c0-b3b6-2ce610eaf349_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL Y HATCHBACK Long Range AWD 5dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425658%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Saving data for 117425658: {'created_time': 1764788460.91029, 'last_price_update_time': 1764788460.910301, 'auction_closing_time': 1764842400.0}
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425658') HTTP/1.1" 204 0
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117573681
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573681%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117573681: 0
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117399593
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399593%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117399593: 0
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117474004
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474004%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117474004: 0
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117573137
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573137%27 HTTP/1.1" 200 None
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117573137: 0
2025-12-03 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117444820
2025-12-03 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444820%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117444820: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117584754
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584754%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117584754: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117240480
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240480%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117240480: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117579304
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579304%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117579304: 1
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9096e418-08e9-4699-acbe-d1897d9b14c9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9096e418-08e9-4699-acbe-d1897d9b14c9.jpg?w=600 not downloaded yet
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede1590>
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebf0ad0>
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Ffa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117609437
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609437%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117609437: 1
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F52fefe97-9e50-4cc0-a244-e10c4de30595.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/52fefe97-9e50-4cc0-a244-e10c4de30595.jpg?w=600 not downloaded yet
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117740684
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740684%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117740684: 1
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg?w=600 not downloaded yet
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117580238
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580238%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117580238: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117589537
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589537%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117589537: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117589550
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589550%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117589550: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117507387
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507387%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117507387: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117045093
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117045093%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117045093: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117507367
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507367%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117507367: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117548403
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548403%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117548403: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117642793
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642793%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117642793: 1
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa8c5f7ca-208d-4818-9429-5dbf86471457.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a8c5f7ca-208d-4818-9429-5dbf86471457.jpg?w=600 not downloaded yet
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117397605
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117397605: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117548415
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548415%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117548415: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117623142
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623142%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117623142: 1
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg?w=600 not downloaded yet
2025-12-03 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117630789?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117579253
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579253%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117579253: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117580116
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580116%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117580116: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117507378
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507378%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117507378: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117522892
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522892%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117522892: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117601450
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601450%27 HTTP/1.1" 200 None
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117601450: 0
2025-12-03 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117623154
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623154%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117623154: 1
2025-12-03 19:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F21f49de6-bf33-45a6-9e1d-8371366083bb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/21f49de6-bf33-45a6-9e1d-8371366083bb.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117579278
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579278%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117579278: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117740649
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740649%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117740649: 1
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F95fb8986-5784-41e1-9f99-794d3d359f62.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/95fb8986-5784-41e1-9f99-794d3d359f62.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117015819
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117015819: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117061252
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061252%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117061252: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117231043
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231043%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117231043: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117366956
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366956%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117366956: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117451336
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451336%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117451336: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117272138
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272138%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117272138: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117407202
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407202%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117407202: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117418330
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418330%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117418330: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117622575
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622575%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117622575: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117427857
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427857%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117427857: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117489691
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489691%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117489691: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117597555
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597555%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117597555: 1
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117630789, 'registration': 'YY73PDV', 'account': 'VAN040', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 150 Titanium Edition 5dr', 'mileage': 9218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-11-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/dbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg?w=600', 'https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600', 'https://abimg002.imgix.net/dcd8a17a-f371-4652-9de0-18b523e927be.jpg?w=600', 'https://abimg002.imgix.net/91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117630789, 'registration': 'YY73PDV', 'account': 'VAN040', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 150 Titanium Edition 5dr', 'mileage': 9218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-11-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/dbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg?w=600', 'https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600', 'https://abimg002.imgix.net/dcd8a17a-f371-4652-9de0-18b523e927be.jpg?w=600', 'https://abimg002.imgix.net/91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 with identifier: 117630789
2025-12-03 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 with scrape type 1
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fdbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/dbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fde2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/de2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117617912?view=catalogue)
2025-12-03 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117666471
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666471%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117666471: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117681164
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681164%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117681164: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117639372
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639372%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117639372: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117638370
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638370%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117638370: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117680503
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117680503%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117680503: 0
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117704526
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704526%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117704526: 1
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb35a8b51-d556-468e-9bf7-a580fe189445.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b35a8b51-d556-468e-9bf7-a580fe189445.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117418653?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117704752
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704752%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117704752: 1
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fdcd8a17a-f371-4652-9de0-18b523e927be.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/dcd8a17a-f371-4652-9de0-18b523e927be.jpg?w=600 not downloaded yet
2025-12-03 19:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f76a510>
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7254ec63-695f-5f26-8ded-0de20ccd1515/7254ec63-695f-5f26-8ded-0de20ccd1515_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg?w=600 saved to cache
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7254ec63-695f-5f26-8ded-0de20ccd1515
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119c14e990>
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg?w=600 saved to cache
2025-12-03 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117572803
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572803%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117572803: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117639666
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639666%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117639666: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117614020
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614020%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117614020: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117615455
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615455%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117615455: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117615786
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615786%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117615786: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117615634
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615634%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117615634: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117452073
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117452073: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117505585
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505585%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117505585: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117570719
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117570719: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117641304
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641304%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117641304: 1
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg?w=600 not downloaded yet
2025-12-03 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/dbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117630789?view=catalogue)
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117708032
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708032%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117708032: 1
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116419349?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117415492?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117488530?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117496386?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117418653, 'registration': 'SR66JDF', 'account': 'THE109', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d R-Sport 5dr Auto AWD', 'mileage': 54633, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T19:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2016-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-05-04', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SR66JDF/2025-11-25/image/082c6899-5ce4-4b48-84a4-081d692dad6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/22c03f52-5e14-46f4-ac89-2d5942526645_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/62fbb908-a5e6-4936-9558-5a4653464fba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/b7345acc-1807-43f2-8e4c-c5b5a5728a2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/a740814b-6ab8-4945-97f8-c582614a1bb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/8a711484-6aba-4060-87df-9434576b85af_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/98bd9699-d638-4740-a23e-d59990b2de7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/a717c0c0-80de-44c4-a921-86a69914a219_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/4a0df324-94a3-484f-acb6-66acba08bc28_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/18- 11K, 02/22- 24K, 05/22- 25K, 04/24- 39K', 'remarks': '**416**VOSA STATES 17K, 20K, 23K, 25K, 30K, 39K, 49K Fuel Fired Heated with Cabin Pre-Heat and Remote Control 20" Blade 5-spoke grey diamond turned finish InControl Secure Lane Keep Assist and Driver Condition Monitor Privacy glass (rear side and rear glass) Rear View Camera Heated front windscreen SD CARD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f126d7a-049c-4fd7-8c45-ff7e3b544234.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117418653, 'registration': 'SR66JDF', 'account': 'THE109', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d R-Sport 5dr Auto AWD', 'mileage': 54633, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T19:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2016-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-05-04', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SR66JDF/2025-11-25/image/082c6899-5ce4-4b48-84a4-081d692dad6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/22c03f52-5e14-46f4-ac89-2d5942526645_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/62fbb908-a5e6-4936-9558-5a4653464fba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/b7345acc-1807-43f2-8e4c-c5b5a5728a2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/a740814b-6ab8-4945-97f8-c582614a1bb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/8a711484-6aba-4060-87df-9434576b85af_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/98bd9699-d638-4740-a23e-d59990b2de7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/a717c0c0-80de-44c4-a921-86a69914a219_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR66JDF/2025-11-25/image/4a0df324-94a3-484f-acb6-66acba08bc28_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/18- 11K, 02/22- 24K, 05/22- 25K, 04/24- 39K', 'remarks': '**416**VOSA STATES 17K, 20K, 23K, 25K, 30K, 39K, 49K Fuel Fired Heated with Cabin Pre-Heat and Remote Control 20" Blade 5-spoke grey diamond turned finish InControl Secure Lane Keep Assist and Driver Condition Monitor Privacy glass (rear side and rear glass) Rear View Camera Heated front windscreen SD CARD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': {'siteId': '34457511', 'description': 'Aston Barclay Wakefield'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f126d7a-049c-4fd7-8c45-ff7e3b544234.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93856f55-6573-5af6-b0a8-8b9b5e036a4c with identifier: 117418653
2025-12-03 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93856f55-6573-5af6-b0a8-8b9b5e036a4c with scrape type 2
2025-12-03 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93856f55-6573-5af6-b0a8-8b9b5e036a4c with scrape type 2
2025-12-03 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 93856f55-6573-5af6-b0a8-8b9b5e036a4c, identifier: 117418653
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117377340, 'registration': 'VA71BMO', 'account': 'DAY005', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Step Auto', 'mileage': 56233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 1, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-02-16', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/VA71BMO/2025-12-03/image/44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/e56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/a204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/b03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d7745fda-6077-441a-8498-34004273d5e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print NO SERVICE', 'remarks': '**661** VOSA STATES 44K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/431e5099-00af-46b7-ab06-dda3edbf217e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117377340, 'registration': 'VA71BMO', 'account': 'DAY005', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Step Auto', 'mileage': 56233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 1, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-02-16', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/VA71BMO/2025-12-03/image/44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/e56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/a204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/b03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d7745fda-6077-441a-8498-34004273d5e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg?w=600', 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print NO SERVICE', 'remarks': '**661** VOSA STATES 44K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/431e5099-00af-46b7-ab06-dda3edbf217e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5fdf8e5-ceff-5761-9047-cd5fd05d28ef with identifier: 117377340
2025-12-03 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef with scrape type 1
2025-12-03 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117683297
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117683297%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117683297: 0
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117707935
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707935%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117707935: 1
2025-12-03 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 93856f55-6573-5af6-b0a8-8b9b5e036a4c with identifier: 117418653
2025-12-03 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 93856f55-6573-5af6-b0a8-8b9b5e036a4c with identifier: 117418653
2025-12-03 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 93856f55-6573-5af6-b0a8-8b9b5e036a4c with identifier: 117418653 to the API
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2793856f55-6573-5af6-b0a8-8b9b5e036a4c%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 93856f55-6573-5af6-b0a8-8b9b5e036a4c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117418653?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T19:00:00Z',
 'fuel_type': 'Diesel',
 'id': '93856f55-6573-5af6-b0a8-8b9b5e036a4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SR66JDF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418653',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'JAGUAR',
 'model': 'F-PACE DIESEL ESTATE',
 'odometer': 54633,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'JAGUAR F-PACE DIESEL ESTATE 2.0d R-Sport 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '2.0d R-Sport 5dr Auto AWD',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418653%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Saving data for 117418653: {'auction_closing_time': 1764874800.0, 'created_time': 1764010949.828112, 'last_price_update_time': 1764788463.770628}
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117418653') HTTP/1.1" 204 0
2025-12-03 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b35a8b51-d556-468e-9bf7-a580fe189445.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fe56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/e56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117580077
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580077%27 HTTP/1.1" 200 None
2025-12-03 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117580077: 1
2025-12-03 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed6bcd0>
2025-12-03 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fdbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/dbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg?w=600 saved to cache
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116419349, 'registration': 'LT19ZUD', 'account': 'AST003', 'make': 'VAUXHALL', 'model': 'MOKKA X DIESEL HATCHBACK', 'derivative': '1.6CDTi [136] Elite 5dr 4WD', 'mileage': 75885, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a39f1560-0961-4b25-9dbb-e7c2995a4632_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/5271fb42-9454-4112-a9d9-4a4ad868880a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/06edee98-ca68-4117-a62f-fb2c4443b6e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/d3e086ae-3944-4b59-9eaf-6ad1e1186762_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/05ff7b38-433d-4bdc-8095-bba21fa8ed3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/9c3852cf-35ba-4bff-8840-4b832c5f3380_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/b029914d-4f05-4044-b579-45fe5a957053_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a54192b6-27bf-49e1-b3d2-990cfe96c35b_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/20-16K, 03/21-29K, 03/22-44K, 03/23-59K, 03/24-73K, 07/25-75K, - EXCESSIVE NOISE FROM UNDER CAR - SUSPECTED TRANSMISSION ISSUE: CODES U0136 & U0078', 'remarks': 'SPARE KEY, VOSA STATES 44K 59K 73K 74K', 'virtual': True, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0be3f5e8-8bcf-4e5c-8bed-daee96f2156a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116419349, 'registration': 'LT19ZUD', 'account': 'AST003', 'make': 'VAUXHALL', 'model': 'MOKKA X DIESEL HATCHBACK', 'derivative': '1.6CDTi [136] Elite 5dr 4WD', 'mileage': 75885, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a39f1560-0961-4b25-9dbb-e7c2995a4632_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/5271fb42-9454-4112-a9d9-4a4ad868880a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/06edee98-ca68-4117-a62f-fb2c4443b6e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/d3e086ae-3944-4b59-9eaf-6ad1e1186762_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/05ff7b38-433d-4bdc-8095-bba21fa8ed3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/9c3852cf-35ba-4bff-8840-4b832c5f3380_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/b029914d-4f05-4044-b579-45fe5a957053_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a54192b6-27bf-49e1-b3d2-990cfe96c35b_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/20-16K, 03/21-29K, 03/22-44K, 03/23-59K, 03/24-73K, 07/25-75K, - EXCESSIVE NOISE FROM UNDER CAR - SUSPECTED TRANSMISSION ISSUE: CODES U0136 & U0078', 'remarks': 'SPARE KEY, VOSA STATES 44K 59K 73K 74K', 'virtual': True, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0be3f5e8-8bcf-4e5c-8bed-daee96f2156a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349
2025-12-03 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d676fcba-aed3-5836-a442-e4f524f9a29d with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d676fcba-aed3-5836-a442-e4f524f9a29d with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d676fcba-aed3-5836-a442-e4f524f9a29d, identifier: 116419349
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117415492, 'registration': 'VK22LFD', 'account': 'HAT004', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '225kW Ultimate 73 kWh 5dr AWD Auto [Tech]', 'mileage': 53980, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 110, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-23', 'fuel': 'Electric', 'motExpiry': '2026-04-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK22LFD/2025-11-25/image/cd41472d-39e3-495e-8547-5738f101e4db_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/97f89def-1f65-49a1-b68d-4d1c710647d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/574a67d4-03fa-4ad8-b810-29c43549b7c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/2551dc10-6943-4a99-a035-faf70f1af340_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/c6208614-4cd4-408b-85e9-901305756a4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/87d4c8c5-dd53-4452-bc1b-e3af90f06482_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/67412c2a-0229-4f67-be4f-6a27b70d27e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/ddf3444c-12f2-4f27-883a-c94967261b54_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/7e0392be-aa2d-454d-9bf4-7fc12f786ede_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/22- 10K, 08/23- 19K', 'remarks': '**133**VOSA STATES 48K  CHARGING CABLE', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/755cd18e-02ef-4f4c-9ae6-32dabc0fcf28.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117415492, 'registration': 'VK22LFD', 'account': 'HAT004', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '225kW Ultimate 73 kWh 5dr AWD Auto [Tech]', 'mileage': 53980, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': 110, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-23', 'fuel': 'Electric', 'motExpiry': '2026-04-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK22LFD/2025-11-25/image/cd41472d-39e3-495e-8547-5738f101e4db_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/97f89def-1f65-49a1-b68d-4d1c710647d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/574a67d4-03fa-4ad8-b810-29c43549b7c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/2551dc10-6943-4a99-a035-faf70f1af340_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/c6208614-4cd4-408b-85e9-901305756a4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/87d4c8c5-dd53-4452-bc1b-e3af90f06482_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/67412c2a-0229-4f67-be4f-6a27b70d27e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/ddf3444c-12f2-4f27-883a-c94967261b54_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22LFD/2025-11-25/image/7e0392be-aa2d-454d-9bf4-7fc12f786ede_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/22- 10K, 08/23- 19K', 'remarks': '**133**VOSA STATES 48K  CHARGING CABLE', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/755cd18e-02ef-4f4c-9ae6-32dabc0fcf28.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b482ca15-c89b-57e9-b897-fddf837f3343 with identifier: 117415492
2025-12-03 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b482ca15-c89b-57e9-b897-fddf837f3343 with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b482ca15-c89b-57e9-b897-fddf837f3343 with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b482ca15-c89b-57e9-b897-fddf837f3343, identifier: 117415492
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117488530, 'registration': 'MJ66DKK', 'account': 'HAR107', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 110 GT Line 5dr', 'mileage': 31024, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/340fb64d-8701-402f-83b2-40a5d33e0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/0b5dfb25-5bc1-4908-b160-191f0a2bd9db_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/f486c5d0-1a25-4933-bf1f-2b0f416f237b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/d7763229-79a6-4a9a-83c7-127532cfdd77_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/45291a37-2a9b-4098-a726-610773fb10e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/65904737-8013-420f-a680-b9fe52c36c1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/77da090e-6a31-4f48-a8d3-573d1e9b16dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/55302d9f-c401-41a0-ad09-a426aa9cefbb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/20 17K 11/21 29K', 'remarks': 'SPARE KEY VOSA STATES 7K 14K 25K 30K 30K 31K', 'virtual': True, 'seller': 'JJ Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2adbcafa-a6e5-4514-aa29-c1a32c00cd84.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117488530, 'registration': 'MJ66DKK', 'account': 'HAR107', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 110 GT Line 5dr', 'mileage': 31024, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/340fb64d-8701-402f-83b2-40a5d33e0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/0b5dfb25-5bc1-4908-b160-191f0a2bd9db_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/f486c5d0-1a25-4933-bf1f-2b0f416f237b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/d7763229-79a6-4a9a-83c7-127532cfdd77_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/45291a37-2a9b-4098-a726-610773fb10e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/65904737-8013-420f-a680-b9fe52c36c1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/77da090e-6a31-4f48-a8d3-573d1e9b16dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/55302d9f-c401-41a0-ad09-a426aa9cefbb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/20 17K 11/21 29K', 'remarks': 'SPARE KEY VOSA STATES 7K 14K 25K 30K 30K 31K', 'virtual': True, 'seller': 'JJ Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2adbcafa-a6e5-4514-aa29-c1a32c00cd84.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5993b719-2a19-5d4f-baef-3d480dab5136 with identifier: 117488530
2025-12-03 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5993b719-2a19-5d4f-baef-3d480dab5136 with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5993b719-2a19-5d4f-baef-3d480dab5136 with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5993b719-2a19-5d4f-baef-3d480dab5136, identifier: 117488530
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116489973, 'registration': 'KF17FNM', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS SALOON', 'derivative': 'C350e Sport 4dr Auto', 'mileage': 105217, 'mileageWarranty': False, 'type': 'car', 'saleId': 17985, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T11:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-08-25', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-25', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/d22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/ee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/18- 15K, 10/18- 30K, 06/19- 46K, 02/20- 62K, 02/21- 73K, 01/22- 75K, 06/25- 104K', 'remarks': '**NON-RUNNER COLLECTION ONLY CHELMSFORD - HYBRID FAILURE - MAY HAVE FURHTER FAULTS, SOLD AS SEEN - VOSA STATES 85K, 93K, 101K, 105K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': True, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 48, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116489973, 'registration': 'KF17FNM', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS SALOON', 'derivative': 'C350e Sport 4dr Auto', 'mileage': 105217, 'mileageWarranty': False, 'type': 'car', 'saleId': 17985, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T11:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-08-25', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-25', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/d22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/ee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/18- 15K, 10/18- 30K, 06/19- 46K, 02/20- 62K, 02/21- 73K, 01/22- 75K, 06/25- 104K', 'remarks': '**NON-RUNNER COLLECTION ONLY CHELMSFORD - HYBRID FAILURE - MAY HAVE FURHTER FAULTS, SOLD AS SEEN - VOSA STATES 85K, 93K, 101K, 105K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': True, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 48, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7548a79a-4513-533c-ad6c-500ae576299b with identifier: 116489973
2025-12-03 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7548a79a-4513-533c-ad6c-500ae576299b with scrape type 1
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117496386, 'registration': 'HJ16BMV', 'account': 'CAR340', 'make': 'JAGUAR', 'model': 'XE DIESEL SALOON', 'derivative': '2.0d Prestige 4dr Auto', 'mileage': 106286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-20', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/b8c57721-0fb2-4f4c-8618-68576c56447f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/10acedce-f928-4a56-822e-c79321a0aa2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/36524979-8b01-4e11-889b-555fa203e6c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/0e984f58-3f4e-402b-8414-8eb6c0fb770d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/6a1b3bba-c9c6-47ca-9452-001557e426f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/11a60d8c-5483-46de-ba9a-b342dbfb6e23_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/f1a8a31b-2b5d-415e-bf9f-11e4a061e597_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/d084fdee-cdd9-4d7f-a468-e49e8b7148b1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/18 9K 03/20 27K 11/24 104K', 'remarks': 'SK VOSA STATES 14K 27K 42K 60K 76K 93K 104K', 'virtual': True, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2ee699a8-e01e-42b2-8108-a5981d30b5fc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117496386, 'registration': 'HJ16BMV', 'account': 'CAR340', 'make': 'JAGUAR', 'model': 'XE DIESEL SALOON', 'derivative': '2.0d Prestige 4dr Auto', 'mileage': 106286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-20', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/b8c57721-0fb2-4f4c-8618-68576c56447f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/10acedce-f928-4a56-822e-c79321a0aa2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/36524979-8b01-4e11-889b-555fa203e6c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/0e984f58-3f4e-402b-8414-8eb6c0fb770d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/6a1b3bba-c9c6-47ca-9452-001557e426f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/11a60d8c-5483-46de-ba9a-b342dbfb6e23_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/f1a8a31b-2b5d-415e-bf9f-11e4a061e597_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ16BMV/2025-11-26/image/d084fdee-cdd9-4d7f-a468-e49e8b7148b1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/18 9K 03/20 27K 11/24 104K', 'remarks': 'SK VOSA STATES 14K 27K 42K 60K 76K 93K 104K', 'virtual': True, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2ee699a8-e01e-42b2-8108-a5981d30b5fc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35d116b-3c9d-5423-a3b0-f46f7036581f with identifier: 117496386
2025-12-03 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35d116b-3c9d-5423-a3b0-f46f7036581f with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35d116b-3c9d-5423-a3b0-f46f7036581f with scrape type 2
2025-12-03 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b35d116b-3c9d-5423-a3b0-f46f7036581f, identifier: 117496386
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349
2025-12-03 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349
2025-12-03 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349 to the API
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116419349?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd676fcba-aed3-5836-a442-e4f524f9a29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT19ZUD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116419349',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'MOKKA X DIESEL HATCHBACK',
 'odometer': 75885,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seller_name': 'TCB Group - Value',
 'title': 'VAUXHALL MOKKA X DIESEL HATCHBACK 1.6CDTi [136] Elite 5dr 4WD',
 'transmission': 'manual',
 'trim': '1.6CDTi [136] Elite 5dr 4WD',
 'vin': None,
 'year': 2019}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Saving data for 116419349: {'auction_closing_time': 1764939600.0, 'created_time': 1762369385.840201, 'last_price_update_time': 1764788465.00986}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116419349') HTTP/1.1" 204 0
2025-12-03 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b482ca15-c89b-57e9-b897-fddf837f3343 with identifier: 117415492
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b482ca15-c89b-57e9-b897-fddf837f3343 with identifier: 117415492
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hatfields group', 'price_includes_vat': False, 'title': 'hyundai ioniq 5 electric hatchback 225kw ultimate 73 kwh 5dr awd auto [tech]', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq 5 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 53980, 'odometer_reading_unit': 'mi', 'registration_date': '2022-04-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415492', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '225kw ultimate 73 kwh 5dr awd auto [tech]', 'license_plate': 'vk22lfd', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b482ca15-c89b-57e9-b897-fddf837f3343', 'current_year_diff': 3, 'age_in_months': 43, 'make_model': 'hyundai ioniq 5 electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 86872} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'b482ca15-c89b-57e9-b897-fddf837f3343',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vk22lfd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415492',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq 5 electric hatchback',
     'model': 'ioniq 5 electric hatchback',
     'odometer': 53980,
     'odometer_in_km': 86872,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-04-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'hatfields group',
     'title': 'hyundai ioniq 5 electric hatchback 225kw ultimate 73 kwh '
              '5dr awd auto [tech]',
     'transmission': 'automatic',
     'trim': '225kw ultimate 73 kwh 5dr awd auto [tech]',
     'vin': None,
     'year': 2022}
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b482ca15-c89b-57e9-b897-fddf837f3343 spider: astonbarclay.gb
2025-12-03 19:01:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b482ca15-c89b-57e9-b897-fddf837f3343 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hatfields group', 'price_includes_vat': False, 'title': 'hyundai ioniq 5 electric hatchback 225kw ultimate 73 kwh 5dr awd auto [tech]', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq 5 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 53980, 'odometer_reading_unit': 'mi', 'registration_date': '2022-04-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415492', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '225kw ultimate 73 kwh 5dr awd auto [tech]', 'license_plate': 'vk22lfd', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b482ca15-c89b-57e9-b897-fddf837f3343', 'current_year_diff': 3, 'age_in_months': 43, 'make_model': 'hyundai ioniq 5 electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 86872} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'b482ca15-c89b-57e9-b897-fddf837f3343',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vk22lfd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415492',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq 5 electric hatchback',
     'model': 'ioniq 5 electric hatchback',
     'odometer': 53980,
     'odometer_in_km': 86872,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-04-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'hatfields group',
     'title': 'hyundai ioniq 5 electric hatchback 225kw ultimate 73 kwh '
              '5dr awd auto [tech]',
     'transmission': 'automatic',
     'trim': '225kw ultimate 73 kwh 5dr awd auto [tech]',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'b482ca15-c89b-57e9-b897-fddf837f3343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VK22LFD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415492',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'IONIQ 5 ELECTRIC HATCHBACK',
 'odometer': 53980,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-23',
 'seller_name': 'Hatfields Group',
 'title': 'HYUNDAI IONIQ 5 ELECTRIC HATCHBACK 225kW Ultimate 73 kWh 5dr AWD '
          'Auto [Tech]',
 'transmission': 'automatic',
 'trim': '225kW Ultimate 73 kWh 5dr AWD Auto [Tech]',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415492%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Saving data for 117415492: {'auction_closing_time': 1764927900.0, 'created_time': 1764010893.69417, 'last_price_update_time': 1764788465.241674}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117415492') HTTP/1.1" 204 0
2025-12-03 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5993b719-2a19-5d4f-baef-3d480dab5136 with identifier: 117488530
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5993b719-2a19-5d4f-baef-3d480dab5136 with identifier: 117488530
2025-12-03 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5993b719-2a19-5d4f-baef-3d480dab5136 with identifier: 117488530 to the API
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275993b719-2a19-5d4f-baef-3d480dab5136%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5993b719-2a19-5d4f-baef-3d480dab5136: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117488530?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5993b719-2a19-5d4f-baef-3d480dab5136',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MJ66DKK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117488530',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 31024,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-26',
 'seller_name': 'JJ Group',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 110 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 GT Line 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488530%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Saving data for 117488530: {'auction_closing_time': 1764939600.0, 'created_time': 1764097452.083256, 'last_price_update_time': 1764788465.549873}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117488530') HTTP/1.1" 204 0
2025-12-03 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b35d116b-3c9d-5423-a3b0-f46f7036581f with identifier: 117496386
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b35d116b-3c9d-5423-a3b0-f46f7036581f with identifier: 117496386
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171050 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171050
2025-12-03 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b35d116b-3c9d-5423-a3b0-f46f7036581f spider: astonbarclay.gb
2025-12-03 19:01:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b35d116b-3c9d-5423-a3b0-f46f7036581f due to rule: high_mileage_for_country.json, error: 171050 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171050
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b35d116b-3c9d-5423-a3b0-f46f7036581f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HJ16BMV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117496386',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'JAGUAR',
 'model': 'XE DIESEL SALOON',
 'odometer': 106286,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Local Dealer Group',
 'title': 'JAGUAR XE DIESEL SALOON 2.0d Prestige 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0d Prestige 4dr Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117496386%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Saving data for 117496386: {'auction_closing_time': 1764939600.0, 'created_time': 1764097444.087236, 'last_price_update_time': 1764788465.781735}
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117496386') HTTP/1.1" 204 0
2025-12-03 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117630789?view=catalogue)
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 117741310
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741310%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Scrape type for 117741310: 1
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252Fd22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/d22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117581980?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fa204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/a204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117433885?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 116928605
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928605%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Scrape type for 116928605: 0
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 116928625
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928625%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Scrape type for 116928625: 0
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 117634969
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634969%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [astonbarclay.gb] INFO: Scrape type for 117634969: 1
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75f2d0>
2025-12-03 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb35a8b51-d556-468e-9bf7-a580fe189445.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b35a8b51-d556-468e-9bf7-a580fe189445.jpg?w=600 saved to cache
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:06 [scrapy.extensions.logstats] INFO: Crawled 51 pages (at 51 pages/min), scraped 27 items (at 27 items/min)
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117596515
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596515%27 HTTP/1.1" 200 None
2025-12-03 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117596515: 0
2025-12-03 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117741256
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741256%27 HTTP/1.1" 200 None
2025-12-03 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117741256: 1
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f84e990>
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg?w=600 saved to cache
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1
2025-12-03 19:01:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117581980, 'registration': 'NL16YTF', 'account': 'STA058', 'make': 'FORD', 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 EcoBoost 140 Zetec S Red 3dr', 'mileage': 73671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-12', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL16YTF/2025-11-28/image/4e9679e4-bea7-420f-817e-1da5cdccde3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0f7c056a-7504-47ff-ad99-25c763b9576c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/a237374e-0f5c-4208-909f-26b5978d36dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/e3d37695-b606-4412-8fed-37d0f1a8f129_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/c2d3a6ae-8482-4ba4-918e-63ac41c85b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/2378f734-2368-4249-be4f-e327e614f84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0c8d05a4-577c-49be-b3de-9a60be1b02d4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '05/17-13K, 05/18-19K, 04/19-23K, 06/20-32K, 09/21-48K, 11/22-55K, 04/23-58K, 03/24-64K', 'remarks': 'VOSA STATES 23K 34K 48K 56K 58K 64K 68K', 'virtual': True, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a601dde-279d-43c7-a458-64f4baf3b771.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117581980, 'registration': 'NL16YTF', 'account': 'STA058', 'make': 'FORD', 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 EcoBoost 140 Zetec S Red 3dr', 'mileage': 73671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-12', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL16YTF/2025-11-28/image/4e9679e4-bea7-420f-817e-1da5cdccde3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0f7c056a-7504-47ff-ad99-25c763b9576c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/a237374e-0f5c-4208-909f-26b5978d36dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/e3d37695-b606-4412-8fed-37d0f1a8f129_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/c2d3a6ae-8482-4ba4-918e-63ac41c85b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/2378f734-2368-4249-be4f-e327e614f84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0c8d05a4-577c-49be-b3de-9a60be1b02d4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '05/17-13K, 05/18-19K, 04/19-23K, 06/20-32K, 09/21-48K, 11/22-55K, 04/23-58K, 03/24-64K', 'remarks': 'VOSA STATES 23K 34K 48K 56K 58K 64K 68K', 'virtual': True, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a601dde-279d-43c7-a458-64f4baf3b771.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980
2025-12-03 19:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with scrape type 2
2025-12-03 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with scrape type 2
2025-12-03 19:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a036d9a-b3d7-57e0-af40-e9512ae760d5, identifier: 117581980
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee77bd0>
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117433885, 'registration': 'BV17UHF', 'account': 'THE109', 'make': 'LEXUS', 'model': 'CT HATCHBACK', 'derivative': '200h 1.8 Luxury 5dr CVT Auto', 'mileage': 26700, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T19:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-02-23', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV17UHF/2025-11-26/image/7d77ebbe-afc8-4bbf-8736-432f390a5a19_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/9dde3f46-09eb-4b6b-93da-a76f3db15f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/1b997fd2-ad76-439f-8651-3804e395efea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/c03a9e33-480f-468f-8e18-f6d01650ba04_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/3abd7710-37a9-4581-bfc1-b290a4cde5e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/fe4fa31f-0e97-4d2e-a79b-91544ac3ffe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/4a232255-78a3-490f-a55e-727333530759_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/88ba1965-cd91-4795-a810-b1ec8540d524_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/18-6K, 03/19-10K, 02/20-14K, 02/21-16K, 02/24-24K, 01/25-26K', 'remarks': 'SPARE KEY, VOSA STATES 14K 16K 17K 21K 24K 26K', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85d7ec78-b816-4ce0-a92f-325fe0f1febb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117433885, 'registration': 'BV17UHF', 'account': 'THE109', 'make': 'LEXUS', 'model': 'CT HATCHBACK', 'derivative': '200h 1.8 Luxury 5dr CVT Auto', 'mileage': 26700, 'mileageWarranty': True, 'type': 'car', 'saleId': 17958, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-04T19:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-02-23', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV17UHF/2025-11-26/image/7d77ebbe-afc8-4bbf-8736-432f390a5a19_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/9dde3f46-09eb-4b6b-93da-a76f3db15f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/1b997fd2-ad76-439f-8651-3804e395efea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/c03a9e33-480f-468f-8e18-f6d01650ba04_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/3abd7710-37a9-4581-bfc1-b290a4cde5e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/fe4fa31f-0e97-4d2e-a79b-91544ac3ffe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/4a232255-78a3-490f-a55e-727333530759_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/88ba1965-cd91-4795-a810-b1ec8540d524_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/18-6K, 03/19-10K, 02/20-14K, 02/21-16K, 02/24-24K, 01/25-26K', 'remarks': 'SPARE KEY, VOSA STATES 14K 16K 17K 21K 24K 26K', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85d7ec78-b816-4ce0-a92f-325fe0f1febb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885
2025-12-03 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with scrape type 2
2025-12-03 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with scrape type 2
2025-12-03 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf, identifier: 117433885
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117741418
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741418%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117741418: 1
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980
2025-12-03 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980
2025-12-03 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980 to the API
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117581980?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6a036d9a-b3d7-57e0-af40-e9512ae760d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL16YTF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117581980',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS',
 'odometer': 73671,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'FORD FIESTA HATCHBACK SPECIAL EDITIONS 1.0 EcoBoost 140 Zetec S Red '
          '3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 Zetec S Red 3dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Saving data for 117581980: {'auction_closing_time': 1764939600.0, 'created_time': 1764356497.124503, 'last_price_update_time': 1764788467.444192}
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117581980') HTTP/1.1" 204 0
2025-12-03 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885
2025-12-03 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885
2025-12-03 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885 to the API
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274cb975ab-d82f-5163-b48e-12f5bf23dfdf%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4cb975ab-d82f-5163-b48e-12f5bf23dfdf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117433885?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-04T19:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '4cb975ab-d82f-5163-b48e-12f5bf23dfdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV17UHF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117433885',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'LEXUS',
 'model': 'CT HATCHBACK',
 'odometer': 26700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': 'TCB Group - Prime',
 'title': 'LEXUS CT HATCHBACK 200h 1.8 Luxury 5dr CVT Auto',
 'transmission': 'automatic',
 'trim': '200h 1.8 Luxury 5dr CVT Auto',
 'vin': None,
 'year': 2017}
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Saving data for 117433885: {'auction_closing_time': 1764874800.0, 'created_time': 1764147708.70359, 'last_price_update_time': 1764788467.728218}
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117433885') HTTP/1.1" 204 0
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/de2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/d22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/dcd8a17a-f371-4652-9de0-18b523e927be.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117630789?view=catalogue)
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117630789?view=catalogue)
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fb03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/b03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117271901
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271901%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117271901: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117269087
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269087%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117269087: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117272082
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272082%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117272082: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117270372
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270372%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117270372: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117684407
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117684407%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117684407: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117601685
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601685%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117601685: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117570049
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117570049: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117598232
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598232%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117598232: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117672698
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672698%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117672698: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 116617318
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 116617318: 0
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117070544
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117070544%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117070544: 2
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117195932?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117597555?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623142?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117479539?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116485815?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117144969?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fd7745fda-6077-441a-8498-34004273d5e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d7745fda-6077-441a-8498-34004273d5e3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed01150>
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed01890>
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 117553459
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-12-03 19:01:08 [astonbarclay.gb] INFO: Scrape type for 117553459: 2
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252Fee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/ee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 117507922
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-12-03 19:01:08 [astonbarclay.gb] INFO: Scrape type for 117507922: 2
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed741d0>
2025-12-03 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fde2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/de2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg?w=600 saved to cache
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f9d6e10>
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252Fd22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/d22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f785290>
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fdcd8a17a-f371-4652-9de0-18b523e927be.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/dcd8a17a-f371-4652-9de0-18b523e927be.jpg?w=600 saved to cache
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8be910>
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600 saved to cache
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1
2025-12-03 19:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1, skipping ID generation
2025-12-03 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 with scrape type 1
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 from tracking dictionaries
2025-12-03 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 sending to next pipeline
2025-12-03 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1, identifier: 117630789
2025-12-03 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e2eb750>
2025-12-03 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117195932, 'registration': 'DV72GZO', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 14766, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 279, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72GZO/2025-11-19/image/46d0d195-3a29-46e2-a87b-e7ddc3e88d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/4f2ec0cc-0c7b-4b69-8b7f-561c7e0ed835_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/fa32d5c4-36b6-4a2a-a75d-d81bf8b9b4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b67b23ce-b8fd-4ed5-8424-c6ac036fb666_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/16cd4d89-5b16-4285-a1fb-655e5077a4f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/a5b1f7de-a0f8-4350-9c58-f35564028cee_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b62b330d-f6c5-4866-bbf5-6fd5dd50bf8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/75504e8c-5372-47df-8109-7a6f7e36861a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/25 10K', 'remarks': 'VOSA STATES 13K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8378c574-bd27-46e2-ab95-e22168ae2731.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117195932, 'registration': 'DV72GZO', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 14766, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 279, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72GZO/2025-11-19/image/46d0d195-3a29-46e2-a87b-e7ddc3e88d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/4f2ec0cc-0c7b-4b69-8b7f-561c7e0ed835_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/fa32d5c4-36b6-4a2a-a75d-d81bf8b9b4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b67b23ce-b8fd-4ed5-8424-c6ac036fb666_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/16cd4d89-5b16-4285-a1fb-655e5077a4f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/a5b1f7de-a0f8-4350-9c58-f35564028cee_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b62b330d-f6c5-4866-bbf5-6fd5dd50bf8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/75504e8c-5372-47df-8109-7a6f7e36861a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/25 10K', 'remarks': 'VOSA STATES 13K SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8378c574-bd27-46e2-ab95-e22168ae2731.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e241f18-d75e-532d-9a63-40dfeb1ae828 with identifier: 117195932
2025-12-03 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e241f18-d75e-532d-9a63-40dfeb1ae828 with scrape type 1
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7e241f18-d75e-532d-9a63-40dfeb1ae828
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252F46d0d195-3a29-46e2-a87b-e7ddc3e88d9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/46d0d195-3a29-46e2-a87b-e7ddc3e88d9d_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252F4f2ec0cc-0c7b-4b69-8b7f-561c7e0ed835_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/4f2ec0cc-0c7b-4b69-8b7f-561c7e0ed835_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252Ffa32d5c4-36b6-4a2a-a75d-d81bf8b9b4c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/fa32d5c4-36b6-4a2a-a75d-d81bf8b9b4c4_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252Fb67b23ce-b8fd-4ed5-8424-c6ac036fb666_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b67b23ce-b8fd-4ed5-8424-c6ac036fb666_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252F16cd4d89-5b16-4285-a1fb-655e5077a4f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/16cd4d89-5b16-4285-a1fb-655e5077a4f4_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252Fa5b1f7de-a0f8-4350-9c58-f35564028cee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/a5b1f7de-a0f8-4350-9c58-f35564028cee_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252Fb62b330d-f6c5-4866-bbf5-6fd5dd50bf8b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b62b330d-f6c5-4866-bbf5-6fd5dd50bf8b_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72GZO%252F2025-11-19%252Fimage%252F75504e8c-5372-47df-8109-7a6f7e36861a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72GZO/2025-11-19/image/75504e8c-5372-47df-8109-7a6f7e36861a_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7e241f18-d75e-532d-9a63-40dfeb1ae828, identifier: 117195932
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117597555, 'registration': 'CK71ZVS', 'account': 'SPL001', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 81733, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'SERVICE BOOK NO STAMPS', 'remarks': 'FORMER KEEPERS UNKNOWN, VOSA STATES 65K, 66K, 81K, 81K,  Ex-Private Hire', 'virtual': False, 'seller': 'Splend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6dd31961-3f95-403e-8902-38407618c136.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117597555, 'registration': 'CK71ZVS', 'account': 'SPL001', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 81733, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'SERVICE BOOK NO STAMPS', 'remarks': 'FORMER KEEPERS UNKNOWN, VOSA STATES 65K, 66K, 81K, 81K,  Ex-Private Hire', 'virtual': False, 'seller': 'Splend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6dd31961-3f95-403e-8902-38407618c136.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31fd5e4-75e7-56e1-8c46-e07a33a2974b with identifier: 117597555
2025-12-03 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31fd5e4-75e7-56e1-8c46-e07a33a2974b with scrape type 1
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b31fd5e4-75e7-56e1-8c46-e07a33a2974b
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b31fd5e4-75e7-56e1-8c46-e07a33a2974b
2025-12-03 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b31fd5e4-75e7-56e1-8c46-e07a33a2974b, identifier: 117597555
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623142, 'registration': 'DA23JDJ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 22915, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe5d4379-8fe0-4270-b5c4-72805641f51c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623142, 'registration': 'DA23JDJ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 22915, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe5d4379-8fe0-4270-b5c4-72805641f51c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80184be8-bf2b-5e28-8d84-3fbbf9b09886 with identifier: 117623142
2025-12-03 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80184be8-bf2b-5e28-8d84-3fbbf9b09886 with scrape type 1
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 80184be8-bf2b-5e28-8d84-3fbbf9b09886
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 80184be8-bf2b-5e28-8d84-3fbbf9b09886
2025-12-03 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 80184be8-bf2b-5e28-8d84-3fbbf9b09886, identifier: 117623142
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117479539, 'registration': 'BA18USD', 'account': 'HEN022', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d Sport 5dr [Nav/Servotronic]', 'mileage': 80699, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BA18USD/2025-11-26/image/e935cd08-57ec-4f4e-99af-51bc84d2ac9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/bf90fc1a-98ba-4fd4-83e7-4dcd6f40f6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/3c9617ff-37e8-4e36-8cc0-b5cbba98e61a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/3fbc5852-d5b0-4077-af3e-ad573a3e7fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/50883dd1-f4fe-4244-a5ac-a8a8c57dadcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/e2867562-dca8-4bf3-97a1-ab74cca363b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/e4e715b6-aab3-42c6-a48c-e1e7fdfa4f42_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/a473c6dd-8a99-42fb-93c4-a8dd6b4453d1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/19 11k 12/19 11k  08/21 23k', 'remarks': 'VOSA STATES 22K 25K 34K 48K 62K', 'virtual': True, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3659386-5dd4-412a-863f-d71a10b47362.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117479539, 'registration': 'BA18USD', 'account': 'HEN022', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d Sport 5dr [Nav/Servotronic]', 'mileage': 80699, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BA18USD/2025-11-26/image/e935cd08-57ec-4f4e-99af-51bc84d2ac9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/bf90fc1a-98ba-4fd4-83e7-4dcd6f40f6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/3c9617ff-37e8-4e36-8cc0-b5cbba98e61a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/3fbc5852-d5b0-4077-af3e-ad573a3e7fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/50883dd1-f4fe-4244-a5ac-a8a8c57dadcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/e2867562-dca8-4bf3-97a1-ab74cca363b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/e4e715b6-aab3-42c6-a48c-e1e7fdfa4f42_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA18USD/2025-11-26/image/a473c6dd-8a99-42fb-93c4-a8dd6b4453d1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/19 11k 12/19 11k  08/21 23k', 'remarks': 'VOSA STATES 22K 25K 34K 48K 62K', 'virtual': True, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3659386-5dd4-412a-863f-d71a10b47362.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228ed778-e8c1-59fd-bb0c-27b01afbae24 with identifier: 117479539
2025-12-03 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 228ed778-e8c1-59fd-bb0c-27b01afbae24 with scrape type 2
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 228ed778-e8c1-59fd-bb0c-27b01afbae24 with scrape type 2
2025-12-03 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 228ed778-e8c1-59fd-bb0c-27b01afbae24, identifier: 117479539
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116485815, 'registration': 'DV72HNY', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 119104, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 278, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72HNY/2025-10-22/image/2392961c-121c-4e07-a322-a8aa3fcf912c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/ea5529e0-ba79-4fad-96a6-3edb99986842_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/183d95b7-fb0a-41af-9ddb-a51391e5d34e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/fc8c6c5a-c820-4734-9f10-ce68a8b0b8ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/acb01d67-9a1d-4a22-9247-1236e7319f87_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/679ed207-cdd3-4b9f-8c14-c1ecf74954e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/3407de20-3a6f-4408-91d4-2ef7eabba204_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/0981c66e-40e3-4025-8f25-b5918fc1e259_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/8d2e73ce-bca0-4d6a-81b7-6672dd2a0bbe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/24 51K 09/24 73K', 'remarks': 'SPARE KEY, vosa states 118k,', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0baafe2c-211c-454e-9171-a39c6c2f8bf1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116485815, 'registration': 'DV72HNY', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 119104, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 278, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72HNY/2025-10-22/image/2392961c-121c-4e07-a322-a8aa3fcf912c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/ea5529e0-ba79-4fad-96a6-3edb99986842_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/183d95b7-fb0a-41af-9ddb-a51391e5d34e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/fc8c6c5a-c820-4734-9f10-ce68a8b0b8ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/acb01d67-9a1d-4a22-9247-1236e7319f87_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/679ed207-cdd3-4b9f-8c14-c1ecf74954e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/3407de20-3a6f-4408-91d4-2ef7eabba204_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/0981c66e-40e3-4025-8f25-b5918fc1e259_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/8d2e73ce-bca0-4d6a-81b7-6672dd2a0bbe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/24 51K 09/24 73K', 'remarks': 'SPARE KEY, vosa states 118k,', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0baafe2c-211c-454e-9171-a39c6c2f8bf1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d38ee2-3076-534d-b497-8423fcf5da59 with identifier: 116485815
2025-12-03 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d38ee2-3076-534d-b497-8423fcf5da59 with scrape type 1
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 68d38ee2-3076-534d-b497-8423fcf5da59
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252F2392961c-121c-4e07-a322-a8aa3fcf912c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/2392961c-121c-4e07-a322-a8aa3fcf912c_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252Fea5529e0-ba79-4fad-96a6-3edb99986842_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/ea5529e0-ba79-4fad-96a6-3edb99986842_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252F183d95b7-fb0a-41af-9ddb-a51391e5d34e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/183d95b7-fb0a-41af-9ddb-a51391e5d34e_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252Ffc8c6c5a-c820-4734-9f10-ce68a8b0b8ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/fc8c6c5a-c820-4734-9f10-ce68a8b0b8ce_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252Facb01d67-9a1d-4a22-9247-1236e7319f87_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/acb01d67-9a1d-4a22-9247-1236e7319f87_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252F679ed207-cdd3-4b9f-8c14-c1ecf74954e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/679ed207-cdd3-4b9f-8c14-c1ecf74954e2_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252F3407de20-3a6f-4408-91d4-2ef7eabba204_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/3407de20-3a6f-4408-91d4-2ef7eabba204_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252F0981c66e-40e3-4025-8f25-b5918fc1e259_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/0981c66e-40e3-4025-8f25-b5918fc1e259_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72HNY%252F2025-10-22%252Fimage%252F8d2e73ce-bca0-4d6a-81b7-6672dd2a0bbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72HNY/2025-10-22/image/8d2e73ce-bca0-4d6a-81b7-6672dd2a0bbe_removebg.jpg?w=600 already downloaded
2025-12-03 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 68d38ee2-3076-534d-b497-8423fcf5da59, identifier: 116485815
2025-12-03 19:01:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117144969, 'registration': 'BX69OWG', 'account': 'HEN022', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost ST-Line 3dr', 'mileage': 82835, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-17', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BX69OWG/2025-11-14/image/1c15e7c3-7644-416f-af19-d41cc090cae1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/638d5ab8-06a9-43d4-ab45-864872499b2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/23e98a24-389f-4135-acf0-1f654bc5176e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/52441a25-fd9b-46f9-8094-20daca18e8ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/c142649b-b491-4914-bcaf-3f4e2c0d1679_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/caba5f71-44d5-450b-8dc3-3d08046281f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/d908f173-a41d-4dcf-a2f2-fb102237b3a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/e0db9a3a-73af-412e-835a-a8bdaed18a19_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/21-13K, 07/22-31K, 11/23-51K, 11/24-65K', 'remarks': 'SPARE KEY, VOSA STATES 34K 48K 63K 81K', 'virtual': True, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee88a6fa-0c1b-41f5-b5ea-1a26634d0678.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117144969, 'registration': 'BX69OWG', 'account': 'HEN022', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost ST-Line 3dr', 'mileage': 82835, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 58}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-17', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BX69OWG/2025-11-14/image/1c15e7c3-7644-416f-af19-d41cc090cae1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/638d5ab8-06a9-43d4-ab45-864872499b2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/23e98a24-389f-4135-acf0-1f654bc5176e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/52441a25-fd9b-46f9-8094-20daca18e8ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/c142649b-b491-4914-bcaf-3f4e2c0d1679_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/caba5f71-44d5-450b-8dc3-3d08046281f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/d908f173-a41d-4dcf-a2f2-fb102237b3a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BX69OWG/2025-11-14/image/e0db9a3a-73af-412e-835a-a8bdaed18a19_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/21-13K, 07/22-31K, 11/23-51K, 11/24-65K', 'remarks': 'SPARE KEY, VOSA STATES 34K 48K 63K 81K', 'virtual': True, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee88a6fa-0c1b-41f5-b5ea-1a26634d0678.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2ddfd1a-9711-590a-94dd-bcd16838780c with identifier: 117144969
2025-12-03 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2ddfd1a-9711-590a-94dd-bcd16838780c with scrape type 2
2025-12-03 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2ddfd1a-9711-590a-94dd-bcd16838780c with scrape type 2
2025-12-03 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2ddfd1a-9711-590a-94dd-bcd16838780c, identifier: 117144969
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fd42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 with identifier: 117630789
2025-12-03 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 with identifier: 117630789
2025-12-03 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1 with identifier: 117630789 to the API
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY73PDV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117630789',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 9218,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51294,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/dbc2107b-4bca-4fc9-90e2-b7f5ca484655.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50942,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/8301e1f3-55ee-4741-ab22-bc880c73c6d0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45232,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/dcd8a17a-f371-4652-9de0-18b523e927be.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1/7e9ee1c7-6ed8-5509-a767-7cdbcb6bdcf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33540,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/91e1b3ea-4c3d-4ad3-adcf-1ba2bfc08bef.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-14',
 'seller_name': 'Vantage Motor Group',
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost 150 Titanium Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBoost 150 Titanium Edition 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117630789%27 HTTP/1.1" 200 None
2025-12-03 19:01:11 [astonbarclay.gb] INFO: Saving data for 117630789: {'created_time': 1764788471.544212, 'last_price_update_time': 1764788471.544224, 'auction_closing_time': 1764927900.0}
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117630789') HTTP/1.1" 204 0
2025-12-03 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7e241f18-d75e-532d-9a63-40dfeb1ae828 with identifier: 117195932
2025-12-03 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7e241f18-d75e-532d-9a63-40dfeb1ae828 with identifier: 117195932
2025-12-03 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7e241f18-d75e-532d-9a63-40dfeb1ae828 with identifier: 117195932 to the API
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117195932?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7e241f18-d75e-532d-9a63-40dfeb1ae828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV72GZO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117195932',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 14766,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/DV72GZO/2025-11-19/image/46d0d195-3a29-46e2-a87b-e7ddc3e88d9d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/4f2ec0cc-0c7b-4b69-8b7f-561c7e0ed835_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/fa32d5c4-36b6-4a2a-a75d-d81bf8b9b4c4_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b67b23ce-b8fd-4ed5-8424-c6ac036fb666_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/16cd4d89-5b16-4285-a1fb-655e5077a4f4_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/a5b1f7de-a0f8-4350-9c58-f35564028cee_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b62b330d-f6c5-4866-bbf5-6fd5dd50bf8b_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/75504e8c-5372-47df-8109-7a6f7e36861a_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32131,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/46d0d195-3a29-46e2-a87b-e7ddc3e88d9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30989,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/4f2ec0cc-0c7b-4b69-8b7f-561c7e0ed835_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31739,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/fa32d5c4-36b6-4a2a-a75d-d81bf8b9b4c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31263,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b67b23ce-b8fd-4ed5-8424-c6ac036fb666_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48036,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/16cd4d89-5b16-4285-a1fb-655e5077a4f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43507,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/a5b1f7de-a0f8-4350-9c58-f35564028cee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56495,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/b62b330d-f6c5-4866-bbf5-6fd5dd50bf8b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e241f18-d75e-532d-9a63-40dfeb1ae828/7e241f18-d75e-532d-9a63-40dfeb1ae828_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49306,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72GZO/2025-11-19/image/75504e8c-5372-47df-8109-7a6f7e36861a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195932%27 HTTP/1.1" 200 None
2025-12-03 19:01:11 [astonbarclay.gb] INFO: Saving data for 117195932: {'created_time': 1764788471.963697, 'last_price_update_time': 1764788471.963707, 'auction_closing_time': 1764842400.0}
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195932') HTTP/1.1" 204 0
2025-12-03 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b31fd5e4-75e7-56e1-8c46-e07a33a2974b with identifier: 117597555
2025-12-03 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b31fd5e4-75e7-56e1-8c46-e07a33a2974b with identifier: 117597555
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'splend', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 81733, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-02', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117597555', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ck71zvs', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b31fd5e4-75e7-56e1-8c46-e07a33a2974b', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 131536} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b31fd5e4-75e7-56e1-8c46-e07a33a2974b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ck71zvs',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117597555',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 81733,
     'odometer_in_km': 131536,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-02',
     'sanitized_make': 'hyundai',
     'seller_name': 'splend',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b31fd5e4-75e7-56e1-8c46-e07a33a2974b spider: astonbarclay.gb
2025-12-03 19:01:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b31fd5e4-75e7-56e1-8c46-e07a33a2974b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'splend', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 81733, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-02', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117597555', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ck71zvs', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b31fd5e4-75e7-56e1-8c46-e07a33a2974b', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 131536} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b31fd5e4-75e7-56e1-8c46-e07a33a2974b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ck71zvs',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117597555',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 81733,
     'odometer_in_km': 131536,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-02',
     'sanitized_make': 'hyundai',
     'seller_name': 'splend',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b31fd5e4-75e7-56e1-8c46-e07a33a2974b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'CK71ZVS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117597555',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'IONIQ ELECTRIC HATCHBACK',
 'odometer': 81733,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seller_name': 'Splend',
 'title': 'HYUNDAI IONIQ ELECTRIC HATCHBACK 100kW Premium 38kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Premium 38kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597555%27 HTTP/1.1" 200 None
2025-12-03 19:01:12 [astonbarclay.gb] INFO: Saving data for 117597555: {'created_time': 1764788472.160723, 'last_price_update_time': 1764788472.160735, 'auction_closing_time': 1765188000.0}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117597555') HTTP/1.1" 204 0
2025-12-03 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 80184be8-bf2b-5e28-8d84-3fbbf9b09886 with identifier: 117623142
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 80184be8-bf2b-5e28-8d84-3fbbf9b09886 with identifier: 117623142
2025-12-03 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 80184be8-bf2b-5e28-8d84-3fbbf9b09886 with identifier: 117623142 to the API
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2780184be8-bf2b-5e28-8d84-3fbbf9b09886%27 HTTP/1.1" 200 None
2025-12-03 19:01:12 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 80184be8-bf2b-5e28-8d84-3fbbf9b09886: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:11 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117623142?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '80184be8-bf2b-5e28-8d84-3fbbf9b09886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA23JDJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623142',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 22915,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623142%27 HTTP/1.1" 200 None
2025-12-03 19:01:12 [astonbarclay.gb] INFO: Saving data for 117623142: {'created_time': 1764788472.466778, 'last_price_update_time': 1764788472.466787, 'auction_closing_time': 1765188000.0}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623142') HTTP/1.1" 204 0
2025-12-03 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 228ed778-e8c1-59fd-bb0c-27b01afbae24 with identifier: 117479539
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 228ed778-e8c1-59fd-bb0c-27b01afbae24 with identifier: 117479539
2025-12-03 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 228ed778-e8c1-59fd-bb0c-27b01afbae24 with identifier: 117479539 to the API
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117479539?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '228ed778-e8c1-59fd-bb0c-27b01afbae24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BA18USD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117479539',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 80699,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': 'Car360',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d Sport 5dr [Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '116d Sport 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2018}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479539%27 HTTP/1.1" 200 None
2025-12-03 19:01:12 [astonbarclay.gb] INFO: Saving data for 117479539: {'auction_closing_time': 1764939600.0, 'created_time': 1764184105.085733, 'last_price_update_time': 1764788472.771198}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117479539') HTTP/1.1" 204 0
2025-12-03 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 68d38ee2-3076-534d-b497-8423fcf5da59 with identifier: 116485815
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 68d38ee2-3076-534d-b497-8423fcf5da59 with identifier: 116485815
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191678 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191678
2025-12-03 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 68d38ee2-3076-534d-b497-8423fcf5da59 spider: astonbarclay.gb
2025-12-03 19:01:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 68d38ee2-3076-534d-b497-8423fcf5da59 due to rule: high_mileage_for_country.json, error: 191678 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191678
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '68d38ee2-3076-534d-b497-8423fcf5da59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV72HNY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116485815',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 119104,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photo_urls': ['https://abimg003.imgix.net/DV72HNY/2025-10-22/image/2392961c-121c-4e07-a322-a8aa3fcf912c_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/ea5529e0-ba79-4fad-96a6-3edb99986842_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/183d95b7-fb0a-41af-9ddb-a51391e5d34e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/fc8c6c5a-c820-4734-9f10-ce68a8b0b8ce_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/acb01d67-9a1d-4a22-9247-1236e7319f87_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/679ed207-cdd3-4b9f-8c14-c1ecf74954e2_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/3407de20-3a6f-4408-91d4-2ef7eabba204_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/0981c66e-40e3-4025-8f25-b5918fc1e259_removebg.jpg?w=600',
                'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/8d2e73ce-bca0-4d6a-81b7-6672dd2a0bbe_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/2392961c-121c-4e07-a322-a8aa3fcf912c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27356,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/ea5529e0-ba79-4fad-96a6-3edb99986842_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28903,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/183d95b7-fb0a-41af-9ddb-a51391e5d34e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27178,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/fc8c6c5a-c820-4734-9f10-ce68a8b0b8ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52347,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/acb01d67-9a1d-4a22-9247-1236e7319f87_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62557,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/679ed207-cdd3-4b9f-8c14-c1ecf74954e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43086,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/3407de20-3a6f-4408-91d4-2ef7eabba204_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60623,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/0981c66e-40e3-4025-8f25-b5918fc1e259_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68d38ee2-3076-534d-b497-8423fcf5da59/68d38ee2-3076-534d-b497-8423fcf5da59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52337,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72HNY/2025-10-22/image/8d2e73ce-bca0-4d6a-81b7-6672dd2a0bbe_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116485815%27 HTTP/1.1" 200 None
2025-12-03 19:01:12 [astonbarclay.gb] INFO: Saving data for 116485815: {'created_time': 1764788472.989705, 'last_price_update_time': 1764788472.989714, 'auction_closing_time': 1764842400.0}
2025-12-03 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116485815') HTTP/1.1" 204 0
2025-12-03 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2ddfd1a-9711-590a-94dd-bcd16838780c with identifier: 117144969
2025-12-03 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2ddfd1a-9711-590a-94dd-bcd16838780c with identifier: 117144969
2025-12-03 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2ddfd1a-9711-590a-94dd-bcd16838780c with identifier: 117144969 to the API
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117144969?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e2ddfd1a-9711-590a-94dd-bcd16838780c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BX69OWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117144969',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 82835,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': 'Car360',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost ST-Line 3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line 3dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144969%27 HTTP/1.1" 200 None
2025-12-03 19:01:13 [astonbarclay.gb] INFO: Saving data for 117144969: {'auction_closing_time': 1764939600.0, 'created_time': 1763147189.000791, 'last_price_update_time': 1764788473.304219}
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117144969') HTTP/1.1" 204 0
2025-12-03 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/b03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/e56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/a204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117267875
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267875%27 HTTP/1.1" 200 None
2025-12-03 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117267875: 2
2025-12-03 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e9510>
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8875d0>
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed6cdd0>
2025-12-03 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:14 [astonbarclay.gb] INFO: Found listing with ID: 116800442
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-12-03 19:01:14 [astonbarclay.gb] INFO: Scrape type for 116800442: 2
2025-12-03 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d7745fda-6077-441a-8498-34004273d5e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/ee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:14 [astonbarclay.gb] INFO: Found listing with ID: 117213849
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-12-03 19:01:14 [astonbarclay.gb] INFO: Scrape type for 117213849: 2
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117641304?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117741418?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117741256?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634969?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117741310?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed22b10>
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fb03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/b03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f862e10>
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fe56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/e56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ece9d90>
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fa204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/a204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eceb590>
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117704752, 'registration': 'WF66KPY', 'account': 'WBA003', 'make': 'LEXUS', 'model': 'CT HATCHBACK', 'derivative': '200h 1.8 F-Sport 5dr CVT Auto', 'mileage': 61983, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1239, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WF66KPY/2025-12-03/image/ff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/b2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18- 10K, 09/19- 17K, 09/20- 24K, 09/21- 34K, 10/22- 44K, 10/23- 56K, 01/25- 60K', 'remarks': 'VOSA STATES 46K, 56K, 60K, 61K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43f6e689-d431-48a1-a33d-9ea0296169cc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117704752, 'registration': 'WF66KPY', 'account': 'WBA003', 'make': 'LEXUS', 'model': 'CT HATCHBACK', 'derivative': '200h 1.8 F-Sport 5dr CVT Auto', 'mileage': 61983, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1239, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WF66KPY/2025-12-03/image/ff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/b2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18- 10K, 09/19- 17K, 09/20- 24K, 09/21- 34K, 10/22- 44K, 10/23- 56K, 01/25- 60K', 'remarks': 'VOSA STATES 46K, 56K, 60K, 61K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43f6e689-d431-48a1-a33d-9ea0296169cc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ffbb60-6752-5e2f-9710-3f9860fec8a6 with identifier: 117704752
2025-12-03 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6 with scrape type 1
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252Fff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/ff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Ff496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116489973?view=catalogue)
2025-12-03 19:01:15 [astonbarclay.gb] INFO: Found listing with ID: 117419626
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419626%27 HTTP/1.1" 200 None
2025-12-03 19:01:15 [astonbarclay.gb] INFO: Scrape type for 117419626: 2
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:15 [astonbarclay.gb] INFO: Found listing with ID: 117517475
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-12-03 19:01:15 [astonbarclay.gb] INFO: Scrape type for 117517475: 2
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252Fb2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/b2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f842650>
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fd7745fda-6077-441a-8498-34004273d5e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d7745fda-6077-441a-8498-34004273d5e3_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f82a090>
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252Fee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/ee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117641304, 'registration': 'LN66OEK', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4dr Tip Auto', 'mileage': 98354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-03-30', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9e636929-492e-4315-8f64-0d215bc2a071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117641304, 'registration': 'LN66OEK', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4dr Tip Auto', 'mileage': 98354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-03-30', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9e636929-492e-4315-8f64-0d215bc2a071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c97a298-58c1-5a8d-8056-bd31d23404d9 with identifier: 117641304
2025-12-03 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c97a298-58c1-5a8d-8056-bd31d23404d9 with scrape type 1
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7c97a298-58c1-5a8d-8056-bd31d23404d9
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7c97a298-58c1-5a8d-8056-bd31d23404d9
2025-12-03 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c97a298-58c1-5a8d-8056-bd31d23404d9, identifier: 117641304
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117741418, 'registration': 'KT66OXM', 'account': 'MAN037', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi Tekna 5dr [7 Seat]', 'mileage': 83957, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-01-05', 'fuel': 'Diesel', 'motExpiry': '2026-02-12', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c9e706d-a6c5-4cb7-8681-6fd882e6902e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117741418, 'registration': 'KT66OXM', 'account': 'MAN037', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi Tekna 5dr [7 Seat]', 'mileage': 83957, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-01-05', 'fuel': 'Diesel', 'motExpiry': '2026-02-12', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c9e706d-a6c5-4cb7-8681-6fd882e6902e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2b2830-15b0-587c-8c45-99938cff7e1c with identifier: 117741418
2025-12-03 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2b2830-15b0-587c-8c45-99938cff7e1c with scrape type 1
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0b2b2830-15b0-587c-8c45-99938cff7e1c
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0b2b2830-15b0-587c-8c45-99938cff7e1c
2025-12-03 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0b2b2830-15b0-587c-8c45-99938cff7e1c, identifier: 117741418
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117704526, 'registration': 'YG16PGV', 'account': 'WBA003', 'make': 'BMW', 'model': '5 SERIES DIESEL TOURING', 'derivative': '535d M Sport 5dr Step Auto', 'mileage': 102032, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1235, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-21', 'fuel': 'Diesel', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YG16PGV/2025-12-03/image/7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/fe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/a0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/b4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/c799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL VOSA STATES 64K, 67K, 88K, 99K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8885341-519c-476f-82f9-ed403d9bad37.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117704526, 'registration': 'YG16PGV', 'account': 'WBA003', 'make': 'BMW', 'model': '5 SERIES DIESEL TOURING', 'derivative': '535d M Sport 5dr Step Auto', 'mileage': 102032, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1235, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-21', 'fuel': 'Diesel', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YG16PGV/2025-12-03/image/7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/fe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/a0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/b4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/c799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL VOSA STATES 64K, 67K, 88K, 99K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8885341-519c-476f-82f9-ed403d9bad37.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0656eb57-fe82-5758-80c6-9c94c5cb8791 with identifier: 117704526
2025-12-03 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0656eb57-fe82-5758-80c6-9c94c5cb8791 with scrape type 1
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117741256, 'registration': 'YA67UMU', 'account': 'MAN037', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 85 Zetec 5dr', 'mileage': 72996, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-01-07', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8bc0b7c-d6da-40d3-bec7-2949b9bc977b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117741256, 'registration': 'YA67UMU', 'account': 'MAN037', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 85 Zetec 5dr', 'mileage': 72996, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-01-07', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8bc0b7c-d6da-40d3-bec7-2949b9bc977b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef84bd2b-05a7-5a66-862f-1536bc5989fc with identifier: 117741256
2025-12-03 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef84bd2b-05a7-5a66-862f-1536bc5989fc with scrape type 1
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ef84bd2b-05a7-5a66-862f-1536bc5989fc
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ef84bd2b-05a7-5a66-862f-1536bc5989fc
2025-12-03 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ef84bd2b-05a7-5a66-862f-1536bc5989fc, identifier: 117741256
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117634969, 'registration': 'BF16VTK', 'account': 'THE109', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 40645, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-02', 'fuel': 'Diesel', 'motExpiry': '2025-10-02', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'STOLEN/RECOVERED - Damage is front end and rear end', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117634969, 'registration': 'BF16VTK', 'account': 'THE109', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 40645, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-02', 'fuel': 'Diesel', 'motExpiry': '2025-10-02', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'STOLEN/RECOVERED - Damage is front end and rear end', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac83957-cfd3-5c52-94e4-e53f50af4789 with identifier: 117634969
2025-12-03 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac83957-cfd3-5c52-94e4-e53f50af4789 with scrape type 1
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6ac83957-cfd3-5c52-94e4-e53f50af4789
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6ac83957-cfd3-5c52-94e4-e53f50af4789
2025-12-03 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6ac83957-cfd3-5c52-94e4-e53f50af4789, identifier: 117634969
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117741310, 'registration': 'LK66PHV', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T Exclusiv 5dr', 'mileage': 90152, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-10', 'fuel': 'Petrol', 'motExpiry': '2026-09-01', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a5151b6-d24b-4a1a-8ff5-53d43f4373aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117741310, 'registration': 'LK66PHV', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T Exclusiv 5dr', 'mileage': 90152, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-10', 'fuel': 'Petrol', 'motExpiry': '2026-09-01', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a5151b6-d24b-4a1a-8ff5-53d43f4373aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59217ad9-38b6-54e8-84e1-03056dae9b6b with identifier: 117741310
2025-12-03 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59217ad9-38b6-54e8-84e1-03056dae9b6b with scrape type 1
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 59217ad9-38b6-54e8-84e1-03056dae9b6b
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 59217ad9-38b6-54e8-84e1-03056dae9b6b
2025-12-03 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 59217ad9-38b6-54e8-84e1-03056dae9b6b, identifier: 117741310
2025-12-03 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/95fb8986-5784-41e1-9f99-794d3d359f62.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117623725
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623725%27 HTTP/1.1" 200 None
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117623725: 0
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117600062
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600062%27 HTTP/1.1" 200 None
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117600062: 0
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117544347
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544347%27 HTTP/1.1" 200 None
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117544347: 2
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252Fa951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c97a298-58c1-5a8d-8056-bd31d23404d9 with identifier: 117641304
2025-12-03 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c97a298-58c1-5a8d-8056-bd31d23404d9 with identifier: 117641304
2025-12-03 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158285 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158285
2025-12-03 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7c97a298-58c1-5a8d-8056-bd31d23404d9 spider: astonbarclay.gb
2025-12-03 19:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7c97a298-58c1-5a8d-8056-bd31d23404d9 due to rule: high_mileage_for_country.json, error: 158285 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158285
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '7c97a298-58c1-5a8d-8056-bd31d23404d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN66OEK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641304',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA DIESEL COUPE',
 'odometer': 98354,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seller_name': 'TCB Group - Prime',
 'title': 'MERCEDES-BENZ CLA DIESEL COUPE CLA 220d AMG Line 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 220d AMG Line 4dr Tip Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641304%27 HTTP/1.1" 200 None
2025-12-03 19:01:16 [astonbarclay.gb] INFO: Saving data for 117641304: {'created_time': 1764788476.997799, 'last_price_update_time': 1764788476.997808, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117641304') HTTP/1.1" 204 0
2025-12-03 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0b2b2830-15b0-587c-8c45-99938cff7e1c with identifier: 117741418
2025-12-03 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0b2b2830-15b0-587c-8c45-99938cff7e1c with identifier: 117741418
2025-12-03 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0b2b2830-15b0-587c-8c45-99938cff7e1c with identifier: 117741418 to the API
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270b2b2830-15b0-587c-8c45-99938cff7e1c%27 HTTP/1.1" 200 None
2025-12-03 19:01:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0b2b2830-15b0-587c-8c45-99938cff7e1c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117741418?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '0b2b2830-15b0-587c-8c45-99938cff7e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KT66OXM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117741418',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'X-TRAIL DIESEL STATION WAGON',
 'odometer': 83957,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-05',
 'seller_name': 'Manamanx Ltd',
 'title': 'NISSAN X-TRAIL DIESEL STATION WAGON 1.6 dCi Tekna 5dr [7 Seat]',
 'transmission': 'manual',
 'trim': '1.6 dCi Tekna 5dr [7 Seat]',
 'vin': None,
 'year': 2017}
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741418%27 HTTP/1.1" 200 None
2025-12-03 19:01:17 [astonbarclay.gb] INFO: Saving data for 117741418: {'created_time': 1764788477.35045, 'last_price_update_time': 1764788477.350459, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117741418') HTTP/1.1" 204 0
2025-12-03 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ef84bd2b-05a7-5a66-862f-1536bc5989fc with identifier: 117741256
2025-12-03 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ef84bd2b-05a7-5a66-862f-1536bc5989fc with identifier: 117741256
2025-12-03 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ef84bd2b-05a7-5a66-862f-1536bc5989fc with identifier: 117741256 to the API
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ef84bd2b-05a7-5a66-862f-1536bc5989fc%27 HTTP/1.1" 200 None
2025-12-03 19:01:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ef84bd2b-05a7-5a66-862f-1536bc5989fc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117741256?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'ef84bd2b-05a7-5a66-862f-1536bc5989fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YA67UMU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117741256',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KA+ HATCHBACK',
 'odometer': 72996,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': 'Manamanx Ltd',
 'title': 'FORD KA+ HATCHBACK 1.2 85 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.2 85 Zetec 5dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741256%27 HTTP/1.1" 200 None
2025-12-03 19:01:17 [astonbarclay.gb] INFO: Saving data for 117741256: {'created_time': 1764788477.643427, 'last_price_update_time': 1764788477.643436, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117741256') HTTP/1.1" 204 0
2025-12-03 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6ac83957-cfd3-5c52-94e4-e53f50af4789 with identifier: 117634969
2025-12-03 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6ac83957-cfd3-5c52-94e4-e53f50af4789 with identifier: 117634969
2025-12-03 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6ac83957-cfd3-5c52-94e4-e53f50af4789 with identifier: 117634969 to the API
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276ac83957-cfd3-5c52-94e4-e53f50af4789%27 HTTP/1.1" 200 None
2025-12-03 19:01:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6ac83957-cfd3-5c52-94e4-e53f50af4789: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117634969?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '6ac83957-cfd3-5c52-94e4-e53f50af4789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BF16VTK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634969',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 40645,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': 'TCB Group - Prime',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE Tech 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 SE Tech 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634969%27 HTTP/1.1" 200 None
2025-12-03 19:01:17 [astonbarclay.gb] INFO: Saving data for 117634969: {'created_time': 1764788477.996873, 'last_price_update_time': 1764788477.996884, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634969') HTTP/1.1" 204 0
2025-12-03 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 59217ad9-38b6-54e8-84e1-03056dae9b6b with identifier: 117741310
2025-12-03 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 59217ad9-38b6-54e8-84e1-03056dae9b6b with identifier: 117741310
2025-12-03 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 59217ad9-38b6-54e8-84e1-03056dae9b6b with identifier: 117741310 to the API
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2759217ad9-38b6-54e8-84e1-03056dae9b6b%27 HTTP/1.1" 200 None
2025-12-03 19:01:18 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 59217ad9-38b6-54e8-84e1-03056dae9b6b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117741310?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '59217ad9-38b6-54e8-84e1-03056dae9b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LK66PHV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117741310',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 90152,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-10',
 'seller_name': 'Manamanx Ltd',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.4T Exclusiv 5dr',
 'transmission': 'manual',
 'trim': '1.4T Exclusiv 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741310%27 HTTP/1.1" 200 None
2025-12-03 19:01:18 [astonbarclay.gb] INFO: Saving data for 117741310: {'created_time': 1764788478.298573, 'last_price_update_time': 1764788478.298585, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117741310') HTTP/1.1" 204 0
2025-12-03 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/ff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/21f49de6-bf33-45a6-9e1d-8371366083bb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Ffe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/fe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117422764
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422764%27 HTTP/1.1" 200 None
2025-12-03 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117422764: 2
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed44d50>
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed16a10>
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Fd42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee9d350>
2025-12-03 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF17FNM%252F2025-10-20%252Fimage%252F6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7548a79a-4513-533c-ad6c-500ae576299b
2025-12-03 19:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7548a79a-4513-533c-ad6c-500ae576299b, skipping ID generation
2025-12-03 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7548a79a-4513-533c-ad6c-500ae576299b with scrape type 1
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7548a79a-4513-533c-ad6c-500ae576299b from tracking dictionaries
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7548a79a-4513-533c-ad6c-500ae576299b sending to next pipeline
2025-12-03 19:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7548a79a-4513-533c-ad6c-500ae576299b, identifier: 116489973
2025-12-03 19:01:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117580077, 'registration': 'EF16EGV', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 250 AMG 4dr', 'mileage': 65566, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-21', 'fuel': 'Petrol', 'motExpiry': '2026-04-19', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/EF16EGV/2025-12-03/image/5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/fd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/c3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/e20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': 'Cat C Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'CAT C - SALVAGE - Damage is undercarriage and all over Category C Insurance Loss. Vehicle Extensively Damaged But Repairable -Insurer Decided Not To Repair', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b368d23f-147f-4894-a159-13e4a3ab31f5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117580077, 'registration': 'EF16EGV', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 250 AMG 4dr', 'mileage': 65566, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-21', 'fuel': 'Petrol', 'motExpiry': '2026-04-19', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/EF16EGV/2025-12-03/image/5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/fd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/c3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/e20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': 'Cat C Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'CAT C - SALVAGE - Damage is undercarriage and all over Category C Insurance Loss. Vehicle Extensively Damaged But Repairable -Insurer Decided Not To Repair', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b368d23f-147f-4894-a159-13e4a3ab31f5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1168908-d757-5b09-9644-887600accffa with identifier: 117580077
2025-12-03 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1168908-d757-5b09-9644-887600accffa with scrape type 1
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d4890>
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7548a79a-4513-533c-ad6c-500ae576299b with identifier: 116489973
2025-12-03 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7548a79a-4513-533c-ad6c-500ae576299b with identifier: 116489973
2025-12-03 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169329 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169329
2025-12-03 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7548a79a-4513-533c-ad6c-500ae576299b spider: astonbarclay.gb
2025-12-03 19:01:19 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7548a79a-4513-533c-ad6c-500ae576299b due to rule: high_mileage_for_country.json, error: 169329 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169329
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T11:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '7548a79a-4513-533c-ad6c-500ae576299b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KF17FNM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116489973',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS SALOON',
 'odometer': 105217,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34507,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e52256f-157f-4caa-ba63-880ffa602ae6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39699,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/d22d709c-d248-4981-aec1-24d9c3d53208_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26027,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/5772cc1b-7017-4489-b4ea-898030782b77_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35259,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/82bb830f-a065-4918-b32d-39411a1b42b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65929,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/2850d6fd-e97c-4d70-9fec-d09c5b385cd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45451,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/6e14196f-55d3-4b74-8a2c-67775b782cdb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7548a79a-4513-533c-ad6c-500ae576299b/7548a79a-4513-533c-ad6c-500ae576299b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73851,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF17FNM/2025-10-20/image/ee273af6-2e1a-463d-9350-cffdd095686a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-25',
 'seller_name': 'CarGiant',
 'title': 'MERCEDES-BENZ C CLASS SALOON C350e Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': 'C350e Sport 4dr Auto',
 'vin': None,
 'year': 2017}
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116489973%27 HTTP/1.1" 200 None
2025-12-03 19:01:19 [astonbarclay.gb] INFO: Saving data for 116489973: {'created_time': 1764788479.75364, 'last_price_update_time': 1764788479.75365, 'auction_closing_time': 1764932400.0}
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116489973') HTTP/1.1" 204 0
2025-12-03 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/b2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117447500
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447500%27 HTTP/1.1" 200 None
2025-12-03 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117447500: 2
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Ffd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/fd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed378d0>
2025-12-03 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F95fb8986-5784-41e1-9f99-794d3d359f62.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/95fb8986-5784-41e1-9f99-794d3d359f62.jpg?w=600 saved to cache
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117377340?view=catalogue)
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Fa0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/a0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 117623566
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623566%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Scrape type for 117623566: 0
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 117661968
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661968%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Scrape type for 117661968: 0
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 117663579
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663579%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Scrape type for 117663579: 0
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 116788960
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116788960%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [astonbarclay.gb] INFO: Scrape type for 116788960: 2
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edc3b50>
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252Fff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/ff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecaa6d0>
2025-12-03 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F21f49de6-bf33-45a6-9e1d-8371366083bb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/21f49de6-bf33-45a6-9e1d-8371366083bb.jpg?w=600 saved to cache
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f76dbd0>
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252F46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6ec310>
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8b9950>
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252Fb2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/b2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 116804294
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804294%27 HTTP/1.1" 200 None
2025-12-03 19:01:22 [astonbarclay.gb] INFO: Scrape type for 116804294: 2
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edb6490>
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee24750>
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVA71BMO%252F2025-12-03%252Fimage%252Ff496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef
2025-12-03 19:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5fdf8e5-ceff-5761-9047-cd5fd05d28ef, skipping ID generation
2025-12-03 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef with scrape type 1
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef from tracking dictionaries
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5fdf8e5-ceff-5761-9047-cd5fd05d28ef sending to next pipeline
2025-12-03 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e5fdf8e5-ceff-5761-9047-cd5fd05d28ef, identifier: 117377340
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507922?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117213849?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117267875?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117070544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116800442?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e5fdf8e5-ceff-5761-9047-cd5fd05d28ef with identifier: 117377340
2025-12-03 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e5fdf8e5-ceff-5761-9047-cd5fd05d28ef with identifier: 117377340
2025-12-03 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e5fdf8e5-ceff-5761-9047-cd5fd05d28ef with identifier: 117377340 to the API
2025-12-03 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'e5fdf8e5-ceff-5761-9047-cd5fd05d28ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VA71BMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117377340',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 56233,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36721,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/44d62aca-91ea-4202-b6b1-bf555038c675_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37113,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/e56aacaa-fd8d-44a8-9cc2-0b32146fd4c9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36307,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/12da1d13-440f-4fd7-b383-7d82cc36c37d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35748,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/a204c993-16a4-4109-a36b-4609be7f45d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57505,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/080c8a5a-88c3-4809-8520-f0285c5bae7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57484,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/9dd7c8ed-0464-4eac-92e1-02172b5cb187_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60386,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/b03b71a4-cecd-4a5e-9711-45c090b630e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58949,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d7745fda-6077-441a-8498-34004273d5e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47382,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/7f29d762-6ca6-4f4c-8e6d-be430a189b8f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62773,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/d42de58b-d2fe-42c4-a817-54ffd420cb1e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62868,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/5fdbbc88-16de-4905-90b8-0cdcd0e1b42d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61750,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/46be93e3-bfc0-4304-a4fa-32d835f49342_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5fdf8e5-ceff-5761-9047-cd5fd05d28ef/e5fdf8e5-ceff-5761-9047-cd5fd05d28ef_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59210,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VA71BMO/2025-12-03/image/f496604d-f1ca-4d5a-aa35-38878b1a99d7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seller_name': 'Days Fleet',
 'title': 'BMW 3 SERIES SALOON 330e M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e M Sport 4dr Step Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117377340%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [astonbarclay.gb] INFO: Saving data for 117377340: {'created_time': 1764788483.229012, 'last_price_update_time': 1764788483.229021, 'auction_closing_time': 1764927900.0}
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117377340') HTTP/1.1" 204 0
2025-12-03 19:01:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117707935, 'registration': 'VO66VXF', 'account': 'CAR001', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 92999, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/acb1c81f-608d-496c-b229-8e078e225634_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/dc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/24 84K - 01/24', 'remarks': 'Ex-Private Hire - VOSA STATES 75K- 77K- 84K- 89K-', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 89, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad8ca538-6dba-42f2-ba45-e3d83f6ecc46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117707935, 'registration': 'VO66VXF', 'account': 'CAR001', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 92999, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/acb1c81f-608d-496c-b229-8e078e225634_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/dc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/24 84K - 01/24', 'remarks': 'Ex-Private Hire - VOSA STATES 75K- 77K- 84K- 89K-', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 89, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad8ca538-6dba-42f2-ba45-e3d83f6ecc46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d129c6d6-e3b1-561b-a574-2d6bb74cb558 with identifier: 117707935
2025-12-03 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d129c6d6-e3b1-561b-a574-2d6bb74cb558 with scrape type 1
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fa57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/fd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117711277
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117711277%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117711277: 1
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Fc3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/c3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fd3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c9cd0>
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1d090>
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Found listing with ID: 117459104
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459104%27 HTTP/1.1" 200 None
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Scrape type for 117459104: 2
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8946d0>
2025-12-03 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117507922, 'registration': 'LF20YOT', 'account': 'WIL004', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Premium 5dr 2WD', 'mileage': 39066, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-03-20', 'fuel': 'Petrol', 'motExpiry': '2026-03-21', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LF20YOT/2025-11-27/image/eb351ef8-5ed1-4df0-9fcb-77dd95370d8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8811ce2c-4522-4aa8-a3f4-67f8aeed9563_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/a17a3315-f23f-42f4-89a8-ed545a6cb218_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/46f9f763-9b6b-4f6e-b31b-587f3677772f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/49c4caf7-e10e-46d7-8448-cd09575245d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8a8d4672-5368-4208-b02b-22024545c1eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/785383ee-227e-4b0d-94f8-c6db3582ed68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/494d2044-6654-40a8-b349-0d8d37eee06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/4946d4c1-65c4-4299-84b6-34345542e6dc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/22 3K 01/23 12K 04/25 31K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d3ce837-366c-424b-9885-1ae5139a2f3b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117507922, 'registration': 'LF20YOT', 'account': 'WIL004', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Premium 5dr 2WD', 'mileage': 39066, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-03-20', 'fuel': 'Petrol', 'motExpiry': '2026-03-21', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LF20YOT/2025-11-27/image/eb351ef8-5ed1-4df0-9fcb-77dd95370d8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8811ce2c-4522-4aa8-a3f4-67f8aeed9563_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/a17a3315-f23f-42f4-89a8-ed545a6cb218_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/46f9f763-9b6b-4f6e-b31b-587f3677772f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/49c4caf7-e10e-46d7-8448-cd09575245d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8a8d4672-5368-4208-b02b-22024545c1eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/785383ee-227e-4b0d-94f8-c6db3582ed68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/494d2044-6654-40a8-b349-0d8d37eee06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/4946d4c1-65c4-4299-84b6-34345542e6dc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/22 3K 01/23 12K 04/25 31K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d3ce837-366c-424b-9885-1ae5139a2f3b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f136d4-69ee-5979-8eda-f19240210d9e with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f136d4-69ee-5979-8eda-f19240210d9e with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 04f136d4-69ee-5979-8eda-f19240210d9e, identifier: 117507922
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117213849, 'registration': 'WO17CYW', 'account': 'THE109', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 73050, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WO17CYW/2025-11-19/image/827d4323-939e-4640-8096-c18a3df9a1d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/225ffae3-8282-40f2-a69f-3f267aaadd38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/0e7aa2bd-cf12-45e8-af41-6cb3218d99e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/40543e69-5a9a-474b-97a9-a42561a16a8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/75c9eaea-2366-45b5-b4af-774940e104a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/28b99b7a-3b2f-45d3-a081-82cf9801cb37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/5e158c1a-47cc-4690-a526-ecad035654b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/9e1086a9-1719-4e9d-999d-106679161d5d_removebg.jpg?w=600'], 'colour': 'PINK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/18 14k 05/20 31k', 'remarks': 'SPARE KEY VOSA STATES 34K 41K 51K 66K 72K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a643c060-ef89-408e-b55f-c089cd19c6ac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117213849, 'registration': 'WO17CYW', 'account': 'THE109', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 73050, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WO17CYW/2025-11-19/image/827d4323-939e-4640-8096-c18a3df9a1d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/225ffae3-8282-40f2-a69f-3f267aaadd38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/0e7aa2bd-cf12-45e8-af41-6cb3218d99e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/40543e69-5a9a-474b-97a9-a42561a16a8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/75c9eaea-2366-45b5-b4af-774940e104a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/28b99b7a-3b2f-45d3-a081-82cf9801cb37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/5e158c1a-47cc-4690-a526-ecad035654b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/9e1086a9-1719-4e9d-999d-106679161d5d_removebg.jpg?w=600'], 'colour': 'PINK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/18 14k 05/20 31k', 'remarks': 'SPARE KEY VOSA STATES 34K 41K 51K 66K 72K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a643c060-ef89-408e-b55f-c089cd19c6ac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e918acf-6531-571b-9318-820d9979e399 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e918acf-6531-571b-9318-820d9979e399 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4e918acf-6531-571b-9318-820d9979e399, identifier: 117213849
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117708032, 'registration': 'YT69UHZ', 'account': 'CAR003', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Visia 5dr', 'mileage': 32456, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/fbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/ef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/d9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/24 25K -', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and normal wear VOSA STATES 18K- 21K- 25K- 28K-', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117708032, 'registration': 'YT69UHZ', 'account': 'CAR003', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Visia 5dr', 'mileage': 32456, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/fbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/ef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/d9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/24 25K -', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and normal wear VOSA STATES 18K- 21K- 25K- 28K-', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d658bee-3528-5144-b65e-4886d6dd3af2 with identifier: 117708032
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d658bee-3528-5144-b65e-4886d6dd3af2 with scrape type 1
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Ffbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/fbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117553459, 'registration': 'CF21OTU', 'account': 'MER023', 'make': 'MERCEDES-BENZ', 'model': 'GLA AMG HATCHBACK', 'derivative': 'GLA 35 4Matic 5dr Auto', 'mileage': 44180, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 08/22 7K 08/23 21K / INV 06/25 39K', 'remarks': 'SKEY - Active Parking Assist with PARKTRONIC, THERMOTRONIC automatic climate control, Heat-insulating dark-tinted glass, Media-Display,  Heated front seats, Leather package, Parking Package, Mirror Package, Leather black, Apple Car Play', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 186, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5aa1fab7-883b-4574-93cc-e5b4fbdedfce.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117553459, 'registration': 'CF21OTU', 'account': 'MER023', 'make': 'MERCEDES-BENZ', 'model': 'GLA AMG HATCHBACK', 'derivative': 'GLA 35 4Matic 5dr Auto', 'mileage': 44180, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 08/22 7K 08/23 21K / INV 06/25 39K', 'remarks': 'SKEY - Active Parking Assist with PARKTRONIC, THERMOTRONIC automatic climate control, Heat-insulating dark-tinted glass, Media-Display,  Heated front seats, Leather package, Parking Package, Mirror Package, Leather black, Apple Car Play', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 186, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5aa1fab7-883b-4574-93cc-e5b4fbdedfce.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dc17995d-aa9a-58e1-aeca-5d47c7b7a620, identifier: 117553459
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117267875, 'registration': 'CK72NUB', 'account': 'GRS002', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 52544, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CK72NUB/2025-11-20/image/75ae5458-14ca-4f16-b3be-fbebf20d8282_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/4442dea3-c482-47c1-9ef2-7712409cbec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/5c36a8b4-cf95-47fb-8b26-f89cb9e6e6e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/42946dde-5a41-461a-94f9-85d04ed84c82_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/413e62c1-1ab4-4d50-a531-14182f803aff_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/5c5d31c1-f785-4446-8aaa-ca742f7be21a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/ec397cef-cc19-4880-a009-7e65cc65674d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/2dc7e9b8-ca47-4167-9c74-47708bbac837_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/05cd6825-0456-4c98-aa15-da0042756750_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/1bdd4b60-0f6e-4abc-936b-6043cdc29072_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 11/23 16K', 'remarks': 'SKEY / SCAN COPY OF V5', 'virtual': False, 'seller': 'GRS Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bbf0981-a735-4827-9ba2-29d9b338c9f0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117267875, 'registration': 'CK72NUB', 'account': 'GRS002', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 52544, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CK72NUB/2025-11-20/image/75ae5458-14ca-4f16-b3be-fbebf20d8282_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/4442dea3-c482-47c1-9ef2-7712409cbec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/5c36a8b4-cf95-47fb-8b26-f89cb9e6e6e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/42946dde-5a41-461a-94f9-85d04ed84c82_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/413e62c1-1ab4-4d50-a531-14182f803aff_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/5c5d31c1-f785-4446-8aaa-ca742f7be21a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/ec397cef-cc19-4880-a009-7e65cc65674d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/2dc7e9b8-ca47-4167-9c74-47708bbac837_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/05cd6825-0456-4c98-aa15-da0042756750_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK72NUB/2025-11-20/image/1bdd4b60-0f6e-4abc-936b-6043cdc29072_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 11/23 16K', 'remarks': 'SKEY / SCAN COPY OF V5', 'virtual': False, 'seller': 'GRS Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bbf0981-a735-4827-9ba2-29d9b338c9f0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f33b770c-8e21-5a52-baa1-d6a566b2eb55 with identifier: 117267875
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33b770c-8e21-5a52-baa1-d6a566b2eb55 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f33b770c-8e21-5a52-baa1-d6a566b2eb55 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f33b770c-8e21-5a52-baa1-d6a566b2eb55, identifier: 117267875
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117070544, 'registration': 'NL21XPV', 'account': 'MER023', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDI 4Motion Elegance 5dr DSG', 'mileage': 8657, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-04-26', 'fuel': 'Diesel', 'motExpiry': '2026-04-30', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL21XPV/2025-11-10/image/516a61ed-07ba-4822-808f-0190bcaa8723_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/bf3ad53e-1c1b-45c1-a122-d54555e10345_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/bc2aa74a-e259-4a66-abc5-dcefcd146053_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/1f2b696b-36df-4315-b4fd-d4fe7151b089_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/f437a3dc-98e9-4d4e-95c0-40df9909fe85_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/bc0f5c2b-9d26-4d6c-a66d-5ac8a68cac42_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/dd4d3bed-f434-4c98-900b-a90adab2ff5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/b73a506d-6352-4681-be8c-b8079498d654_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/c6d66253-0974-4d8a-9cdd-44ad7d65faa3_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/23 3k', 'remarks': 'Transferable Service Plan Until 30/08/2028 - SKEY (Battery dead) / Tilting sliding glass electric front sunroof, Apple CarPlay, Android Auto,', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b757df5f-110a-4f66-8010-2960da6d75fa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117070544, 'registration': 'NL21XPV', 'account': 'MER023', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDI 4Motion Elegance 5dr DSG', 'mileage': 8657, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-04-26', 'fuel': 'Diesel', 'motExpiry': '2026-04-30', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL21XPV/2025-11-10/image/516a61ed-07ba-4822-808f-0190bcaa8723_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/bf3ad53e-1c1b-45c1-a122-d54555e10345_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/bc2aa74a-e259-4a66-abc5-dcefcd146053_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/1f2b696b-36df-4315-b4fd-d4fe7151b089_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/f437a3dc-98e9-4d4e-95c0-40df9909fe85_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/bc0f5c2b-9d26-4d6c-a66d-5ac8a68cac42_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/dd4d3bed-f434-4c98-900b-a90adab2ff5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/b73a506d-6352-4681-be8c-b8079498d654_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL21XPV/2025-11-10/image/c6d66253-0974-4d8a-9cdd-44ad7d65faa3_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/23 3k', 'remarks': 'Transferable Service Plan Until 30/08/2028 - SKEY (Battery dead) / Tilting sliding glass electric front sunroof, Apple CarPlay, Android Auto,', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b757df5f-110a-4f66-8010-2960da6d75fa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf84d50a-fb22-5510-bb2f-001842966bd3 with identifier: 117070544
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf84d50a-fb22-5510-bb2f-001842966bd3 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf84d50a-fb22-5510-bb2f-001842966bd3 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cf84d50a-fb22-5510-bb2f-001842966bd3, identifier: 117070544
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116800442, 'registration': 'WA66TVP', 'account': 'AST011', 'make': 'VOLKSWAGEN', 'model': 'PASSAT SALOON', 'derivative': '1.4 TSI GTE 4dr DSG', 'mileage': 78564, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-07', 'doors': 4, 'engineSize': 1395, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WA66TVP/2025-11-04/image/9949787c-74e7-4cee-b733-3ca3e7602149_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/a6eb7206-a596-4364-aa8d-1996a7ca7cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2b126097-61bd-4a59-819c-d7926b1118e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/cfde551f-b1e6-4931-932c-cef0c3ebe03f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/96499886-4cc8-4cc6-a9d9-585b7ae70edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/ab1b8341-b38d-4889-8369-8c61bbaf6a18_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2322bdb0-6126-40ac-82e0-9c1819479864_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2d68dfc8-8082-415b-beb9-66be5966dbfa_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/17-6K, 04/18-10K, 08/19-21K, 08/20-28K, 09/21- NO MILEAGE, 04/22-45K, 06/24-70K, 02/25-78K', 'remarks': 'SPARE KEY, VOSA STATES 21K 28K 35K 51K 64K 73K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 39, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8e1d8952-b4ac-4408-baa2-c96ef8ef61c8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116800442, 'registration': 'WA66TVP', 'account': 'AST011', 'make': 'VOLKSWAGEN', 'model': 'PASSAT SALOON', 'derivative': '1.4 TSI GTE 4dr DSG', 'mileage': 78564, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-07', 'doors': 4, 'engineSize': 1395, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WA66TVP/2025-11-04/image/9949787c-74e7-4cee-b733-3ca3e7602149_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/a6eb7206-a596-4364-aa8d-1996a7ca7cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2b126097-61bd-4a59-819c-d7926b1118e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/cfde551f-b1e6-4931-932c-cef0c3ebe03f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/96499886-4cc8-4cc6-a9d9-585b7ae70edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/ab1b8341-b38d-4889-8369-8c61bbaf6a18_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2322bdb0-6126-40ac-82e0-9c1819479864_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2d68dfc8-8082-415b-beb9-66be5966dbfa_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/17-6K, 04/18-10K, 08/19-21K, 08/20-28K, 09/21- NO MILEAGE, 04/22-45K, 06/24-70K, 02/25-78K', 'remarks': 'SPARE KEY, VOSA STATES 21K 28K 35K 51K 64K 73K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 39, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8e1d8952-b4ac-4408-baa2-c96ef8ef61c8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442
2025-12-03 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e537f8b-227e-5a67-90f6-18908247b543 with scrape type 2
2025-12-03 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e537f8b-227e-5a67-90f6-18908247b543 with scrape type 2
2025-12-03 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e537f8b-227e-5a67-90f6-18908247b543, identifier: 116800442
2025-12-03 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/fe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/a0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117725492
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117725492%27 HTTP/1.1" 200 None
2025-12-03 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117725492: 1
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922
2025-12-03 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922
2025-12-03 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922 to the API
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2704f136d4-69ee-5979-8eda-f19240210d9e%27 HTTP/1.1" 200 None
2025-12-03 19:01:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 04f136d4-69ee-5979-8eda-f19240210d9e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507922?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '04f136d4-69ee-5979-8eda-f19240210d9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LF20YOT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507922',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 39066,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-20',
 'seller_name': 'Wilsons',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 GDi Premium 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 GDi Premium 5dr 2WD',
 'vin': None,
 'year': 2020}
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-12-03 19:01:25 [astonbarclay.gb] INFO: Saving data for 117507922: {'auction_closing_time': 1764925200.0, 'created_time': 1764234057.96949, 'last_price_update_time': 1764788485.780588}
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507922') HTTP/1.1" 204 0
2025-12-03 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=PINK HTTP/1.1" 200 None
2025-12-03 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849
2025-12-03 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849 to the API
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117213849?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'PINK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4e918acf-6531-571b-9318-820d9979e399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WO17CYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117213849',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 73050,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'FIAT 500 HATCHBACK 1.2 Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-12-03 19:01:26 [astonbarclay.gb] INFO: Saving data for 117213849: {'auction_closing_time': 1764936000.0, 'created_time': 1763406059.419004, 'last_price_update_time': 1764788486.226686}
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117213849') HTTP/1.1" 204 0
2025-12-03 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459
2025-12-03 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459
2025-12-03 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459 to the API
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'dc17995d-aa9a-58e1-aeca-5d47c7b7a620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CF21OTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117553459',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA AMG HATCHBACK',
 'odometer': 44180,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'MERCEDES-BENZ GLA AMG HATCHBACK GLA 35 4Matic 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 35 4Matic 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-12-03 19:01:26 [astonbarclay.gb] INFO: Saving data for 117553459: {'auction_closing_time': 1764925200.0, 'created_time': 1764270163.69096, 'last_price_update_time': 1764788486.546261}
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117553459') HTTP/1.1" 204 0
2025-12-03 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f33b770c-8e21-5a52-baa1-d6a566b2eb55 with identifier: 117267875
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-03 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f33b770c-8e21-5a52-baa1-d6a566b2eb55 with identifier: 117267875
2025-12-03 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f33b770c-8e21-5a52-baa1-d6a566b2eb55 with identifier: 117267875 to the API
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f33b770c-8e21-5a52-baa1-d6a566b2eb55%27 HTTP/1.1" 200 None
2025-12-03 19:01:26 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f33b770c-8e21-5a52-baa1-d6a566b2eb55: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117267875?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': 'f33b770c-8e21-5a52-baa1-d6a566b2eb55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CK72NUB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117267875',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 52544,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'GRS Motor Group',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267875%27 HTTP/1.1" 200 None
2025-12-03 19:01:26 [astonbarclay.gb] INFO: Saving data for 117267875: {'auction_closing_time': 1764925200.0, 'created_time': 1763578912.883209, 'last_price_update_time': 1764788486.945221}
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117267875') HTTP/1.1" 204 0
2025-12-03 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cf84d50a-fb22-5510-bb2f-001842966bd3 with identifier: 117070544
2025-12-03 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cf84d50a-fb22-5510-bb2f-001842966bd3 with identifier: 117070544
2025-12-03 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cf84d50a-fb22-5510-bb2f-001842966bd3 with identifier: 117070544 to the API
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117070544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cf84d50a-fb22-5510-bb2f-001842966bd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL21XPV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117070544',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN DIESEL ESTATE',
 'odometer': 8657,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'VOLKSWAGEN TIGUAN DIESEL ESTATE 2.0 TDI 4Motion Elegance 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 4Motion Elegance 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117070544%27 HTTP/1.1" 200 None
2025-12-03 19:01:27 [astonbarclay.gb] INFO: Saving data for 117070544: {'auction_closing_time': 1764925200.0, 'created_time': 1762801459.063672, 'last_price_update_time': 1764788487.316894}
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117070544') HTTP/1.1" 204 0
2025-12-03 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442
2025-12-03 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442
2025-12-03 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442 to the API
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272e537f8b-227e-5a67-90f6-18908247b543%27 HTTP/1.1" 200 None
2025-12-03 19:01:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2e537f8b-227e-5a67-90f6-18908247b543: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116800442?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '2e537f8b-227e-5a67-90f6-18908247b543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WA66TVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116800442',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT SALOON',
 'odometer': 78564,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN PASSAT SALOON 1.4 TSI GTE 4dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI GTE 4dr DSG',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-12-03 19:01:27 [astonbarclay.gb] INFO: Saving data for 116800442: {'auction_closing_time': 1765274400.0, 'created_time': 1761764661.806895, 'last_price_update_time': 1764788487.614162}
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116800442') HTTP/1.1" 204 0
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Fb4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/b4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fd9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eadda90>
2025-12-03 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Ffd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/fd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:28 [astonbarclay.gb] INFO: Found listing with ID: 116831329
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831329%27 HTTP/1.1" 200 None
2025-12-03 19:01:28 [astonbarclay.gb] INFO: Scrape type for 116831329: 2
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Fe20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/e20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb8b390>
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9e0d0>
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba0890>
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/c3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Fc799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/c799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede69d0>
2025-12-03 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede5ad0>
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Ffe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/fe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed78410>
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba1550>
2025-12-03 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Fa0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/a0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8665d0>
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117238218
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238218%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117238218: 2
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117422764?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623154?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117419626?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117447500?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116804294?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517475?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117740649?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116788960?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117605544
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605544%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117605544: 1
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede4050>
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Fc3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/c3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cbeaed0>
2025-12-03 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fd3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Facb1c81f-608d-496c-b229-8e078e225634_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/acb1c81f-608d-496c-b229-8e078e225634_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/b4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117101013
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101013%27 HTTP/1.1" 200 None
2025-12-03 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117101013: 2
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Fb6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/e20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebfb4d0>
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7870d0>
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb41c10>
2025-12-03 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252F3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9b550>
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117422764, 'registration': 'AK72ZSF', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 71853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-11-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/bb9005e7-71ed-469b-8171-5367af0b176b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/2990d2d8-05bb-4ac3-b94e-8597518bf23a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/ec7584b8-d6b0-4ffb-b1ca-0ddb0c7114a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/faf3574c-563a-4cec-9792-51b2281dd8d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/15e74153-ad2d-43e7-8af8-27def7d3c4a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/e2b1b70f-c6c1-4690-9a70-5dca8fbc55b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/537a9fba-7929-46ac-9b73-98d7e5fd4b20_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/144c9084-dd51-4e18-b0b9-f06f1bff45ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/86d36ebc-da08-4260-a7d9-8cff212c2324_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/4d671376-8b65-4d2f-af60-d8b4fa84055b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93eb3436-3486-4082-a755-6fb74e12bfbc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117422764, 'registration': 'AK72ZSF', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 71853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-11-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/bb9005e7-71ed-469b-8171-5367af0b176b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/2990d2d8-05bb-4ac3-b94e-8597518bf23a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/ec7584b8-d6b0-4ffb-b1ca-0ddb0c7114a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/faf3574c-563a-4cec-9792-51b2281dd8d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/15e74153-ad2d-43e7-8af8-27def7d3c4a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/e2b1b70f-c6c1-4690-9a70-5dca8fbc55b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/537a9fba-7929-46ac-9b73-98d7e5fd4b20_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/144c9084-dd51-4e18-b0b9-f06f1bff45ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/86d36ebc-da08-4260-a7d9-8cff212c2324_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/4d671376-8b65-4d2f-af60-d8b4fa84055b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93eb3436-3486-4082-a755-6fb74e12bfbc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff812ca-5229-5588-8958-cf0b1796e5b9 with identifier: 117422764
2025-12-03 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff812ca-5229-5588-8958-cf0b1796e5b9 with scrape type 2
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff812ca-5229-5588-8958-cf0b1796e5b9 with scrape type 2
2025-12-03 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dff812ca-5229-5588-8958-cf0b1796e5b9, identifier: 117422764
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623154, 'registration': 'DC23JSZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 17783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cf9096b2-b151-4b02-a167-dc93209358f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623154, 'registration': 'DC23JSZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 17783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cf9096b2-b151-4b02-a167-dc93209358f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154
2025-12-03 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860fb433-3a45-5a34-81ae-e9d9ae170992 with scrape type 1
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 860fb433-3a45-5a34-81ae-e9d9ae170992
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 860fb433-3a45-5a34-81ae-e9d9ae170992
2025-12-03 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 860fb433-3a45-5a34-81ae-e9d9ae170992, identifier: 117623154
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117419626, 'registration': 'OE68XXJ', 'account': 'MOT075', 'make': 'MAZDA', 'model': 'CX-5 DIESEL ESTATE', 'derivative': '2.2d SE-L Nav+ 5dr', 'mileage': 68651, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-01-16', 'fuel': 'Diesel', 'motExpiry': '2025-11-24', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/98418ba1-09b5-4bb0-849a-2f1bf4445b82_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/b10c9ff2-7902-42ea-b7eb-41894d1f22bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/eabf6b9e-db1c-4d7a-83b2-fe2e0491c2be_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/1bb56419-4ac5-42a3-ba33-91ac4258a9ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/bc894db1-a246-4b43-b988-9993594ab2ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/6d8a68ab-63fe-4cfc-b036-d09ff95e3590_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/2e82029a-5c4e-4b3f-9151-f4609ad1c303_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/1f0e3a4e-429b-48d8-8070-d85b9ebd3bd0_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/19-14k, 08/20-26k, 04/21-32k, 09/23-50k, 05/25-68k,', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN, VOSA STATES 40K 40K 44K 53K 63K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/69a3c719-2105-466a-8ec6-294737c11de8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117419626, 'registration': 'OE68XXJ', 'account': 'MOT075', 'make': 'MAZDA', 'model': 'CX-5 DIESEL ESTATE', 'derivative': '2.2d SE-L Nav+ 5dr', 'mileage': 68651, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-01-16', 'fuel': 'Diesel', 'motExpiry': '2025-11-24', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/98418ba1-09b5-4bb0-849a-2f1bf4445b82_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/b10c9ff2-7902-42ea-b7eb-41894d1f22bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/eabf6b9e-db1c-4d7a-83b2-fe2e0491c2be_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/1bb56419-4ac5-42a3-ba33-91ac4258a9ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/bc894db1-a246-4b43-b988-9993594ab2ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/6d8a68ab-63fe-4cfc-b036-d09ff95e3590_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/2e82029a-5c4e-4b3f-9151-f4609ad1c303_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/1f0e3a4e-429b-48d8-8070-d85b9ebd3bd0_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/19-14k, 08/20-26k, 04/21-32k, 09/23-50k, 05/25-68k,', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN, VOSA STATES 40K 40K 44K 53K 63K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/69a3c719-2105-466a-8ec6-294737c11de8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a637c5-0767-5ea0-937b-f3eeb5583fa6 with identifier: 117419626
2025-12-03 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a637c5-0767-5ea0-937b-f3eeb5583fa6 with scrape type 2
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a637c5-0767-5ea0-937b-f3eeb5583fa6 with scrape type 2
2025-12-03 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 16a637c5-0767-5ea0-937b-f3eeb5583fa6, identifier: 117419626
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117447500, 'registration': 'LB71HGP', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 63510, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71HGP/2025-11-27/image/8bdee490-8106-4677-8904-668ef3984f42_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/55483dac-2cfe-4e8c-8472-f9f242765603_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/be52835a-01ed-41da-bf51-f1535c76287b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/f0512e11-83ee-46b5-a1e8-cbbed40ebbe2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/14409b77-ef04-4c65-a95f-554551d65125_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/7db1a87b-c6fb-4b48-880d-6068f5b73020_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/6d624217-e7d9-40ba-acb5-0119c7430a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/65289444-72fa-4c04-adc5-6f063fa02396_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/5ee34554-a74e-4e73-a754-44495f3f6314_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/9cbe0d28-bd39-403c-8962-ccc8b29351ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/01dfe1ce-5abc-4747-99e2-be4c283d76d4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4aed4d1a-dd03-46da-8e02-504d010e9121.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117447500, 'registration': 'LB71HGP', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 63510, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71HGP/2025-11-27/image/8bdee490-8106-4677-8904-668ef3984f42_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/55483dac-2cfe-4e8c-8472-f9f242765603_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/be52835a-01ed-41da-bf51-f1535c76287b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/f0512e11-83ee-46b5-a1e8-cbbed40ebbe2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/14409b77-ef04-4c65-a95f-554551d65125_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/7db1a87b-c6fb-4b48-880d-6068f5b73020_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/6d624217-e7d9-40ba-acb5-0119c7430a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/65289444-72fa-4c04-adc5-6f063fa02396_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/5ee34554-a74e-4e73-a754-44495f3f6314_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/9cbe0d28-bd39-403c-8962-ccc8b29351ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/01dfe1ce-5abc-4747-99e2-be4c283d76d4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4aed4d1a-dd03-46da-8e02-504d010e9121.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with identifier: 117447500
2025-12-03 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with scrape type 2
2025-12-03 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d, identifier: 117447500
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116804294, 'registration': 'BD71HGA', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC40 ELECTRIC ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 86623, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-24', 'fuel': 'Electric', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD71HGA/2025-11-26/image/0a69ae9e-4be1-47e1-aae8-7453cc54e03e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/3aecbdbc-290e-4c32-90d0-d728e5a53ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/fbfc5eeb-ee4c-4467-963f-fd26dc3ff58d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/7b93aa47-1fdc-48c3-aa9b-b99c18913f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/a5794141-1917-4c5e-b765-d24e533cf691_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/025a2f13-7aea-47c7-a18b-0787679858ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/711a3cad-5516-439e-a4d8-26cdb3d88d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/965d70c9-7571-4b59-acf8-4cfd1b15a835_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/e9bf5097-6122-4d21-b8b0-25e7b970edca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/ca98bcc6-a4ab-467f-aefb-93aeaeeabb52_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book BOOK @ 11/22 17K, 10/23 37K, 8/24 57K, PRINT @ 11/22 17K, 10/23 37K, 6/25 77K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f74c933-1611-49b2-91c9-812e0c01505e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116804294, 'registration': 'BD71HGA', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC40 ELECTRIC ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 86623, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-24', 'fuel': 'Electric', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD71HGA/2025-11-26/image/0a69ae9e-4be1-47e1-aae8-7453cc54e03e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/3aecbdbc-290e-4c32-90d0-d728e5a53ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/fbfc5eeb-ee4c-4467-963f-fd26dc3ff58d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/7b93aa47-1fdc-48c3-aa9b-b99c18913f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/a5794141-1917-4c5e-b765-d24e533cf691_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/025a2f13-7aea-47c7-a18b-0787679858ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/711a3cad-5516-439e-a4d8-26cdb3d88d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/965d70c9-7571-4b59-acf8-4cfd1b15a835_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/e9bf5097-6122-4d21-b8b0-25e7b970edca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/ca98bcc6-a4ab-467f-aefb-93aeaeeabb52_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book BOOK @ 11/22 17K, 10/23 37K, 8/24 57K, PRINT @ 11/22 17K, 10/23 37K, 6/25 77K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f74c933-1611-49b2-91c9-812e0c01505e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with identifier: 116804294
2025-12-03 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b15e98-4607-5d69-9d5f-9fa39d614d31 with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55b15e98-4607-5d69-9d5f-9fa39d614d31 with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 55b15e98-4607-5d69-9d5f-9fa39d614d31, identifier: 116804294
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517475, 'registration': 'WD68SFX', 'account': 'MER023', 'make': 'MINI', 'model': 'CONVERTIBLE', 'derivative': '1.5 Cooper II 2dr', 'mileage': 34783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-02-05', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/WD68SFX/2025-11-27/image/4588ebdf-63b0-4300-b6a7-4a246ba11c57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/d08e1c92-e555-4be8-b617-94fba88ef4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/55302db7-8646-4c10-ad6a-eff9b25f9445_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/c47bb734-c777-498a-bf5c-83417bf684c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/60a9bbb6-62f3-4763-bc2c-e07389c7e5ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/da187a0d-df6d-4b5e-832e-a1e0d9c96256_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/bea286eb-2c2b-4172-bd4a-d857d295f1de_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/afd3c6bf-dd10-472a-85cc-401781edfdb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/b105f866-183e-4787-b62d-5f77f855c042_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/25 24K idrive 11/20 7k 10/21 7.8k', 'remarks': 'SKEY - Navigation (including Apple CarPlay), John Cooper Works Sport Pack (includes 17" Track Spoke alloy wheels in black, Performance Control, JCW sport leather steering wheel, JCW rear spoiler, JCW aerodynamic kit, Anthracite headlining, JCW sport seats, Cruise control with brake function, JCW door sill finishers)', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eda77cea-beb9-4840-9a53-0e7a048b7c9a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517475, 'registration': 'WD68SFX', 'account': 'MER023', 'make': 'MINI', 'model': 'CONVERTIBLE', 'derivative': '1.5 Cooper II 2dr', 'mileage': 34783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-02-05', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/WD68SFX/2025-11-27/image/4588ebdf-63b0-4300-b6a7-4a246ba11c57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/d08e1c92-e555-4be8-b617-94fba88ef4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/55302db7-8646-4c10-ad6a-eff9b25f9445_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/c47bb734-c777-498a-bf5c-83417bf684c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/60a9bbb6-62f3-4763-bc2c-e07389c7e5ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/da187a0d-df6d-4b5e-832e-a1e0d9c96256_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/bea286eb-2c2b-4172-bd4a-d857d295f1de_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/afd3c6bf-dd10-472a-85cc-401781edfdb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/b105f866-183e-4787-b62d-5f77f855c042_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/25 24K idrive 11/20 7k 10/21 7.8k', 'remarks': 'SKEY - Navigation (including Apple CarPlay), John Cooper Works Sport Pack (includes 17" Track Spoke alloy wheels in black, Performance Control, JCW sport leather steering wheel, JCW rear spoiler, JCW aerodynamic kit, Anthracite headlining, JCW sport seats, Cruise control with brake function, JCW door sill finishers)', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eda77cea-beb9-4840-9a53-0e7a048b7c9a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475
2025-12-03 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5545fd41-d151-53d7-84d8-81f5483bc2f6 with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5545fd41-d151-53d7-84d8-81f5483bc2f6 with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5545fd41-d151-53d7-84d8-81f5483bc2f6, identifier: 117517475
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117740649, 'registration': 'CU16USL', 'account': 'STA058', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '2.0 CRDi GT-Line 5dr Auto [AWD]', 'mileage': 107383, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-04', 'fuel': 'Diesel', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b45dae5-adc5-4a26-8c56-ddbeab02a7c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117740649, 'registration': 'CU16USL', 'account': 'STA058', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '2.0 CRDi GT-Line 5dr Auto [AWD]', 'mileage': 107383, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-04', 'fuel': 'Diesel', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b45dae5-adc5-4a26-8c56-ddbeab02a7c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13bfd23-9146-56cc-b981-33490bd1b4f8 with identifier: 117740649
2025-12-03 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13bfd23-9146-56cc-b981-33490bd1b4f8 with scrape type 1
2025-12-03 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d13bfd23-9146-56cc-b981-33490bd1b4f8
2025-12-03 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d13bfd23-9146-56cc-b981-33490bd1b4f8
2025-12-03 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d13bfd23-9146-56cc-b981-33490bd1b4f8, identifier: 117740649
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116788960, 'registration': 'VK70ENO', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 96174, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-16', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK70ENO/2025-11-25/image/ff0f706b-530e-4c0b-b7d9-19711a503131_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/48a35505-c711-495f-b868-0293a68000f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0473a4e2-6de0-46ac-a661-3023fd31c916_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0ef0fc9e-dceb-43e9-9e7a-f3ac721710d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/37f569f2-bf66-4924-8cd1-9e2a147c4ebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/65f2e00e-6c3e-4e66-92ae-9db6533e0bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/2b2a97c0-c1ba-4afd-aa27-0f697da9be92_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/1f4d8e88-7489-45e0-bc80-2947c384ada8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/b38579c5-0790-4bcb-91f6-99bb576f16b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/a68991ce-0ea0-4fa9-b13c-949fd0d919b5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/21 17K, 12/21 19K, 11/22 37K, 2/24 61K, 6/24 69K, 6/25 88K,', 'remarks': 'S/KEY (Cover Missing)', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8204f173-e894-419f-a0d5-b14bec49b89f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116788960, 'registration': 'VK70ENO', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 96174, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-16', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK70ENO/2025-11-25/image/ff0f706b-530e-4c0b-b7d9-19711a503131_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/48a35505-c711-495f-b868-0293a68000f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0473a4e2-6de0-46ac-a661-3023fd31c916_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0ef0fc9e-dceb-43e9-9e7a-f3ac721710d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/37f569f2-bf66-4924-8cd1-9e2a147c4ebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/65f2e00e-6c3e-4e66-92ae-9db6533e0bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/2b2a97c0-c1ba-4afd-aa27-0f697da9be92_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/1f4d8e88-7489-45e0-bc80-2947c384ada8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/b38579c5-0790-4bcb-91f6-99bb576f16b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/a68991ce-0ea0-4fa9-b13c-949fd0d919b5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/21 17K, 12/21 19K, 11/22 37K, 2/24 61K, 6/24 69K, 6/25 88K,', 'remarks': 'S/KEY (Cover Missing)', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8204f173-e894-419f-a0d5-b14bec49b89f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2250c9ea-d32d-544d-b536-6725b39e76ee with identifier: 116788960
2025-12-03 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2250c9ea-d32d-544d-b536-6725b39e76ee with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2250c9ea-d32d-544d-b536-6725b39e76ee with scrape type 2
2025-12-03 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2250c9ea-d32d-544d-b536-6725b39e76ee, identifier: 116788960
2025-12-03 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/c799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/fbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117049908
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049908%27 HTTP/1.1" 200 None
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117049908: 2
2025-12-03 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dff812ca-5229-5588-8958-cf0b1796e5b9 with identifier: 117422764
2025-12-03 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dff812ca-5229-5588-8958-cf0b1796e5b9 with identifier: 117422764
2025-12-03 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 115635 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    115635
2025-12-03 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: dff812ca-5229-5588-8958-cf0b1796e5b9 spider: astonbarclay.gb
2025-12-03 19:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: dff812ca-5229-5588-8958-cf0b1796e5b9 due to rule: high_mileage_for_make.json, error: 115635 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    115635
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'dff812ca-5229-5588-8958-cf0b1796e5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AK72ZSF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117422764',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 71853,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON RWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'RWD 4dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422764%27 HTTP/1.1" 200 None
2025-12-03 19:01:33 [astonbarclay.gb] INFO: Saving data for 117422764: {'auction_closing_time': 1764925200.0, 'created_time': 1764356598.52227, 'last_price_update_time': 1764788493.69966}
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117422764') HTTP/1.1" 204 0
2025-12-03 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154
2025-12-03 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154
2025-12-03 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154 to the API
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27860fb433-3a45-5a34-81ae-e9d9ae170992%27 HTTP/1.1" 200 None
2025-12-03 19:01:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 860fb433-3a45-5a34-81ae-e9d9ae170992: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117623154?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '860fb433-3a45-5a34-81ae-e9d9ae170992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JSZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623154',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 17783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623154%27 HTTP/1.1" 200 None
2025-12-03 19:01:34 [astonbarclay.gb] INFO: Saving data for 117623154: {'created_time': 1764788494.068927, 'last_price_update_time': 1764788494.068937, 'auction_closing_time': 1765188000.0}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623154') HTTP/1.1" 204 0
2025-12-03 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 16a637c5-0767-5ea0-937b-f3eeb5583fa6 with identifier: 117419626
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 16a637c5-0767-5ea0-937b-f3eeb5583fa6 with identifier: 117419626
2025-12-03 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 16a637c5-0767-5ea0-937b-f3eeb5583fa6 with identifier: 117419626 to the API
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2716a637c5-0767-5ea0-937b-f3eeb5583fa6%27 HTTP/1.1" 200 None
2025-12-03 19:01:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 16a637c5-0767-5ea0-937b-f3eeb5583fa6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117419626?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '16a637c5-0767-5ea0-937b-f3eeb5583fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OE68XXJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117419626',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MAZDA',
 'model': 'CX-5 DIESEL ESTATE',
 'odometer': 68651,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seller_name': 'MotoNovo Finance',
 'title': 'MAZDA CX-5 DIESEL ESTATE 2.2d SE-L Nav+ 5dr',
 'transmission': 'manual',
 'trim': '2.2d SE-L Nav+ 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419626%27 HTTP/1.1" 200 None
2025-12-03 19:01:34 [astonbarclay.gb] INFO: Saving data for 117419626: {'auction_closing_time': 1764936000.0, 'created_time': 1763751854.775087, 'last_price_update_time': 1764788494.342243}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117419626') HTTP/1.1" 204 0
2025-12-03 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with identifier: 117447500
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with identifier: 117447500
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 102209 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    102209
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d spider: astonbarclay.gb
2025-12-03 19:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d due to rule: high_mileage_for_make.json, error: 102209 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    102209
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '1ae0022f-4c40-5c88-a00a-b00a791fcf1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB71HGP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447500',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 63510,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447500%27 HTTP/1.1" 200 None
2025-12-03 19:01:34 [astonbarclay.gb] INFO: Saving data for 117447500: {'auction_closing_time': 1764925200.0, 'created_time': 1764356708.564733, 'last_price_update_time': 1764788494.626358}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117447500') HTTP/1.1" 204 0
2025-12-03 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with identifier: 116804294
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with identifier: 116804294
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volvo xc40 electric estate 300kw recharge twin pro 78kwh 5dr awd auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'xc40 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 86623, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116804294', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '300kw recharge twin pro 78kwh 5dr awd auto', 'license_plate': 'bd71hga', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '55b15e98-4607-5d69-9d5f-9fa39d614d31', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volvo xc40 electric estate', 'sanitized_make': 'volvo', 'odometer_in_km': 139405} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '55b15e98-4607-5d69-9d5f-9fa39d614d31',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bd71hga',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116804294',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'volvo',
     'make_model': 'volvo xc40 electric estate',
     'model': 'xc40 electric estate',
     'odometer': 86623,
     'odometer_in_km': 139405,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-24',
     'sanitized_make': 'volvo',
     'seller_name': 'zenith',
     'title': 'volvo xc40 electric estate 300kw recharge twin pro 78kwh '
              '5dr awd auto',
     'transmission': 'automatic',
     'trim': '300kw recharge twin pro 78kwh 5dr awd auto',
     'vin': None,
     'year': 2021}
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 spider: astonbarclay.gb
2025-12-03 19:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 55b15e98-4607-5d69-9d5f-9fa39d614d31 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volvo xc40 electric estate 300kw recharge twin pro 78kwh 5dr awd auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'xc40 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 86623, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116804294', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '300kw recharge twin pro 78kwh 5dr awd auto', 'license_plate': 'bd71hga', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '55b15e98-4607-5d69-9d5f-9fa39d614d31', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volvo xc40 electric estate', 'sanitized_make': 'volvo', 'odometer_in_km': 139405} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '55b15e98-4607-5d69-9d5f-9fa39d614d31',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bd71hga',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116804294',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'volvo',
     'make_model': 'volvo xc40 electric estate',
     'model': 'xc40 electric estate',
     'odometer': 86623,
     'odometer_in_km': 139405,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-24',
     'sanitized_make': 'volvo',
     'seller_name': 'zenith',
     'title': 'volvo xc40 electric estate 300kw recharge twin pro 78kwh '
              '5dr awd auto',
     'transmission': 'automatic',
     'trim': '300kw recharge twin pro 78kwh 5dr awd auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '55b15e98-4607-5d69-9d5f-9fa39d614d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BD71HGA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116804294',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLVO',
 'model': 'XC40 ELECTRIC ESTATE',
 'odometer': 86623,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seller_name': 'Zenith',
 'title': 'VOLVO XC40 ELECTRIC ESTATE 300kW Recharge Twin Pro 78kWh 5dr AWD '
          'Auto',
 'transmission': 'automatic',
 'trim': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto',
 'vin': None,
 'year': 2021}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804294%27 HTTP/1.1" 200 None
2025-12-03 19:01:34 [astonbarclay.gb] INFO: Saving data for 116804294: {'auction_closing_time': 1764925200.0, 'created_time': 1764356712.259756, 'last_price_update_time': 1764788494.833706}
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116804294') HTTP/1.1" 204 0
2025-12-03 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475
2025-12-03 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475
2025-12-03 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475 to the API
2025-12-03 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275545fd41-d151-53d7-84d8-81f5483bc2f6%27 HTTP/1.1" 200 None
2025-12-03 19:01:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5545fd41-d151-53d7-84d8-81f5483bc2f6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117517475?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5545fd41-d151-53d7-84d8-81f5483bc2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD68SFX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517475',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MINI',
 'model': 'CONVERTIBLE',
 'odometer': 34783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'MINI CONVERTIBLE 1.5 Cooper II 2dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 2dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-12-03 19:01:35 [astonbarclay.gb] INFO: Saving data for 117517475: {'auction_closing_time': 1765274400.0, 'created_time': 1764184064.481605, 'last_price_update_time': 1764788495.119179}
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517475') HTTP/1.1" 204 0
2025-12-03 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d13bfd23-9146-56cc-b981-33490bd1b4f8 with identifier: 117740649
2025-12-03 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d13bfd23-9146-56cc-b981-33490bd1b4f8 with identifier: 117740649
2025-12-03 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172815 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172815
2025-12-03 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d13bfd23-9146-56cc-b981-33490bd1b4f8 spider: astonbarclay.gb
2025-12-03 19:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d13bfd23-9146-56cc-b981-33490bd1b4f8 due to rule: high_mileage_for_country.json, error: 172815 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172815
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd13bfd23-9146-56cc-b981-33490bd1b4f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CU16USL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117740649',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'SPORTAGE DIESEL ESTATE',
 'odometer': 107383,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-04',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'KIA SPORTAGE DIESEL ESTATE 2.0 CRDi GT-Line 5dr Auto [AWD]',
 'transmission': 'automatic',
 'trim': '2.0 CRDi GT-Line 5dr Auto [AWD]',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740649%27 HTTP/1.1" 200 None
2025-12-03 19:01:35 [astonbarclay.gb] INFO: Saving data for 117740649: {'created_time': 1764788495.357366, 'last_price_update_time': 1764788495.357376, 'auction_closing_time': 1765188000.0}
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117740649') HTTP/1.1" 204 0
2025-12-03 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2250c9ea-d32d-544d-b536-6725b39e76ee with identifier: 116788960
2025-12-03 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2250c9ea-d32d-544d-b536-6725b39e76ee with identifier: 116788960
2025-12-03 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154776 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154776
2025-12-03 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2250c9ea-d32d-544d-b536-6725b39e76ee spider: astonbarclay.gb
2025-12-03 19:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2250c9ea-d32d-544d-b536-6725b39e76ee due to rule: high_mileage_for_country.json, error: 154776 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154776
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2250c9ea-d32d-544d-b536-6725b39e76ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VK70ENO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116788960',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 96174,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Style 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Style 5dr',
 'vin': None,
 'year': 2020}
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116788960%27 HTTP/1.1" 200 None
2025-12-03 19:01:35 [astonbarclay.gb] INFO: Saving data for 116788960: {'auction_closing_time': 1764925200.0, 'created_time': 1764356787.282411, 'last_price_update_time': 1764788495.563831}
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116788960') HTTP/1.1" 204 0
2025-12-03 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fdc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/dc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Fef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/ef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f751fd0>
2025-12-03 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec43490>
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fd9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec5fd90>
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edf9210>
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Fb4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/b4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 116988436
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988436%27 HTTP/1.1" 200 None
2025-12-03 19:01:36 [astonbarclay.gb] INFO: Scrape type for 116988436: 2
2025-12-03 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba2690>
2025-12-03 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Fe20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/e20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/acb1c81f-608d-496c-b229-8e078e225634_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Fd9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/d9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb87690>
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebbbdd0>
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed18950>
2025-12-03 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252Fc799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/c799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebcf990>
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Ffbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/fbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba9850>
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117188762
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188762%27 HTTP/1.1" 200 None
2025-12-03 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117188762: 2
2025-12-03 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580077?view=catalogue)
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Fa577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc77d0>
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed69410>
2025-12-03 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec1e0d0>
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 117405887
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405887%27 HTTP/1.1" 200 None
2025-12-03 19:01:39 [astonbarclay.gb] INFO: Scrape type for 117405887: 2
2025-12-03 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117238218?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117459104?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117725492?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116831329?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d57d0>
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed77650>
2025-12-03 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252F9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f842650>
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Facb1c81f-608d-496c-b229-8e078e225634_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/acb1c81f-608d-496c-b229-8e078e225634_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/dc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707935?view=catalogue)
2025-12-03 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/ef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117639547
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639547%27 HTTP/1.1" 200 None
2025-12-03 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117639547: 1
2025-12-03 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebfc4d0>
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee6b0d0>
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee6b750>
2025-12-03 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF16EGV%252F2025-12-03%252Fimage%252Fb6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d1168908-d757-5b09-9644-887600accffa
2025-12-03 19:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1168908-d757-5b09-9644-887600accffa, skipping ID generation
2025-12-03 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1168908-d757-5b09-9644-887600accffa with scrape type 1
2025-12-03 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d1168908-d757-5b09-9644-887600accffa from tracking dictionaries
2025-12-03 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1168908-d757-5b09-9644-887600accffa sending to next pipeline
2025-12-03 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d1168908-d757-5b09-9644-887600accffa, identifier: 117580077
2025-12-03 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d1168908-d757-5b09-9644-887600accffa with identifier: 117580077
2025-12-03 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d1168908-d757-5b09-9644-887600accffa with identifier: 117580077
2025-12-03 19:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d1168908-d757-5b09-9644-887600accffa with identifier: 117580077 to the API
2025-12-03 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'd1168908-d757-5b09-9644-887600accffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF16EGV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117580077',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 65566,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37458,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/5400f529-e4eb-45f2-a686-dfc20458613c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37277,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/fd64286f-ae35-446f-b82e-cbe9525430b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34837,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/3ebc87b6-ea4d-44bd-8b0a-7cf38fbf3e35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38058,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/327779fc-ecd8-4432-804c-8de9e6b8f06e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/c3180c23-a5b8-4e00-9abc-abe32bb1b5f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46727,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/62ed73ce-4028-4fdd-9d74-ee4a745fafe4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54963,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/8db6cf68-38a6-48b9-a894-1160d3ef6478_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66387,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/e20e303b-9884-454e-b062-1c9eac662e5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49861,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/70d7307a-1489-4508-827f-de11eb4bf69d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53710,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/9b47f289-5e12-4932-bf26-86e6af641fae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1168908-d757-5b09-9644-887600accffa/d1168908-d757-5b09-9644-887600accffa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98152,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/EF16EGV/2025-12-03/image/b6fda53f-daff-40e2-a0ca-c14cb04833d1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 250 AMG 4dr',
 'transmission': 'manual',
 'trim': 'CLA 250 AMG 4dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580077%27 HTTP/1.1" 200 None
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Saving data for 117580077: {'created_time': 1764788502.272867, 'last_price_update_time': 1764788502.272877, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117580077') HTTP/1.1" 204 0
2025-12-03 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG16PGV/2025-12-03/image/78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704526?view=catalogue)
2025-12-03 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/d9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117099385
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099385%27 HTTP/1.1" 200 None
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117099385: 0
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117599696
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599696%27 HTTP/1.1" 200 None
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117599696: 0
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117563844
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563844%27 HTTP/1.1" 200 None
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117563844: 1
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117238218, 'registration': 'GF72VBO', 'account': 'LEA009', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 24622, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-11-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GF72VBO/2025-11-24/image/9b8eb9c6-6115-43e1-bdc8-f89da8844295_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/c2db93c6-344d-4471-ba8f-60d9b9fc63b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/6b2e3046-dc61-43d4-85d2-8fad8caa4821_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/05a9c5eb-c48d-4d8c-bc39-8ae7cb9e14f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/09629660-cb67-4afa-9504-312425ae6ea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/cbce38f4-cf80-4e76-82da-94e1e48a60f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/51707609-f279-43bf-8cd3-43325317fb5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/28ec3a09-138e-4c76-b56d-a4c1f9c67093_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/692a131a-cae5-4a83-baa8-02174a6aab8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/1bf0340b-8439-4409-a903-1335d4d9ee2c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/abc25adc-fe08-4f6b-8a3f-602d7283d881.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117238218, 'registration': 'GF72VBO', 'account': 'LEA009', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 24622, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-11-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GF72VBO/2025-11-24/image/9b8eb9c6-6115-43e1-bdc8-f89da8844295_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/c2db93c6-344d-4471-ba8f-60d9b9fc63b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/6b2e3046-dc61-43d4-85d2-8fad8caa4821_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/05a9c5eb-c48d-4d8c-bc39-8ae7cb9e14f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/09629660-cb67-4afa-9504-312425ae6ea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/cbce38f4-cf80-4e76-82da-94e1e48a60f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/51707609-f279-43bf-8cd3-43325317fb5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/28ec3a09-138e-4c76-b56d-a4c1f9c67093_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/692a131a-cae5-4a83-baa8-02174a6aab8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72VBO/2025-11-24/image/1bf0340b-8439-4409-a903-1335d4d9ee2c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/abc25adc-fe08-4f6b-8a3f-602d7283d881.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c1087c-3679-517d-9aca-e2e22933a243 with identifier: 117238218
2025-12-03 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c1087c-3679-517d-9aca-e2e22933a243 with scrape type 2
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c1087c-3679-517d-9aca-e2e22933a243 with scrape type 2
2025-12-03 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 73c1087c-3679-517d-9aca-e2e22933a243, identifier: 117238218
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117459104, 'registration': 'FP72AZF', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK (RC)', 'derivative': '1.2 PureTech 110 Shine 5dr', 'mileage': 15332, 'mileageWarranty': False, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP72AZF/2025-11-26/image/b0748a02-c759-4314-bf14-114f5e7a8689_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/1b30cbf5-aa05-4cd7-a548-43378a927775_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/0371873d-112a-4ee3-a01b-5183f4ba207b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/45d4496e-28d0-498d-aedc-ec50e3ef462f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/74f6d7da-bd6e-4cb6-91d6-00e1a19907e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/d4b9b63f-01a1-4f61-8d53-2555cad3e2fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/ba76cb86-b9db-4408-b816-befaecb6f0c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/99e08403-2712-4078-bb39-6bcb4a8a5e95_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/5ef66942-38b6-434d-aca4-6ab673218ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/9041c30d-8c93-4cef-8bed-80b1c8edb120_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/e1dabc2b-83e6-43de-844c-3ec43b189e16_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/2cc33883-f81b-49bc-955d-3bc6155f44ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/8c13a3b0-6ecd-4341-bf30-a66fa5529136_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/23 9K 10/24 10K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d768c999-864a-4910-aa7b-e1ecef71b7fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117459104, 'registration': 'FP72AZF', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK (RC)', 'derivative': '1.2 PureTech 110 Shine 5dr', 'mileage': 15332, 'mileageWarranty': False, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP72AZF/2025-11-26/image/b0748a02-c759-4314-bf14-114f5e7a8689_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/1b30cbf5-aa05-4cd7-a548-43378a927775_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/0371873d-112a-4ee3-a01b-5183f4ba207b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/45d4496e-28d0-498d-aedc-ec50e3ef462f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/74f6d7da-bd6e-4cb6-91d6-00e1a19907e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/d4b9b63f-01a1-4f61-8d53-2555cad3e2fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/ba76cb86-b9db-4408-b816-befaecb6f0c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/99e08403-2712-4078-bb39-6bcb4a8a5e95_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/5ef66942-38b6-434d-aca4-6ab673218ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/9041c30d-8c93-4cef-8bed-80b1c8edb120_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/e1dabc2b-83e6-43de-844c-3ec43b189e16_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/2cc33883-f81b-49bc-955d-3bc6155f44ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/8c13a3b0-6ecd-4341-bf30-a66fa5529136_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/23 9K 10/24 10K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d768c999-864a-4910-aa7b-e1ecef71b7fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104
2025-12-03 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349c4d6c-f50a-5e6d-bc25-c14445cedeac with scrape type 2
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349c4d6c-f50a-5e6d-bc25-c14445cedeac with scrape type 2
2025-12-03 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 349c4d6c-f50a-5e6d-bc25-c14445cedeac, identifier: 117459104
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117725492, 'registration': 'HY20MWK', 'account': 'STA058', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium SE 38kWh 5dr Auto', 'mileage': 43881, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-01', 'fuel': 'Electric', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 25K 35K 43K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/233ef877-a236-4ca4-829f-83efe47ec0de.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117725492, 'registration': 'HY20MWK', 'account': 'STA058', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium SE 38kWh 5dr Auto', 'mileage': 43881, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-01', 'fuel': 'Electric', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 25K 35K 43K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/233ef877-a236-4ca4-829f-83efe47ec0de.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 118f7e90-81d8-5014-bf50-d437adee4c16 with identifier: 117725492
2025-12-03 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 118f7e90-81d8-5014-bf50-d437adee4c16 with scrape type 1
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 118f7e90-81d8-5014-bf50-d437adee4c16
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 118f7e90-81d8-5014-bf50-d437adee4c16
2025-12-03 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 118f7e90-81d8-5014-bf50-d437adee4c16, identifier: 117725492
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117711277, 'registration': 'LG21GUV', 'account': 'STA058', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Excite 5dr DCT', 'mileage': 105560, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-22', 'fuel': 'Petrol', 'motExpiry': '2026-07-06', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LG21GUV/2025-12-03/image/463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/b7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/bf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 72K 98K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35a0bf61-2e6d-4cb8-aee8-ae7e75cadbff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117711277, 'registration': 'LG21GUV', 'account': 'STA058', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Excite 5dr DCT', 'mileage': 105560, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-22', 'fuel': 'Petrol', 'motExpiry': '2026-07-06', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LG21GUV/2025-12-03/image/463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/b7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/bf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 72K 98K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35a0bf61-2e6d-4cb8-aee8-ae7e75cadbff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67016abd-d880-54d0-8337-c8bcae532b52 with identifier: 117711277
2025-12-03 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67016abd-d880-54d0-8337-c8bcae532b52 with scrape type 1
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116831329, 'registration': 'KN25XYK', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'TAVASCAN ESTATE', 'derivative': '210kW V1 77kWh 5dr Auto [Winter Pack]', 'mileage': 3998, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2025-03-14', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KN25XYK/2025-11-19/image/a3a72e4c-a546-4822-b3d5-50fe1aebf2dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/c04fd6fa-61a0-416b-b3b2-d023fd94952b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/d59e62d1-7ceb-414f-bc60-cc713550e524_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/67189039-2d80-4968-9a30-e2b0bea01fd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/bbd037c0-b08c-48e2-ad68-01d65cdcb6ce_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2de73511-c3a8-42fc-8889-c5a22261716b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116831329, 'registration': 'KN25XYK', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'TAVASCAN ESTATE', 'derivative': '210kW V1 77kWh 5dr Auto [Winter Pack]', 'mileage': 3998, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2025-03-14', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KN25XYK/2025-11-19/image/a3a72e4c-a546-4822-b3d5-50fe1aebf2dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/c04fd6fa-61a0-416b-b3b2-d023fd94952b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/d59e62d1-7ceb-414f-bc60-cc713550e524_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/67189039-2d80-4968-9a30-e2b0bea01fd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN25XYK/2025-11-19/image/bbd037c0-b08c-48e2-ad68-01d65cdcb6ce_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2de73511-c3a8-42fc-8889-c5a22261716b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d18d05ee-ec23-5d7d-a934-0de11d66656d with identifier: 116831329
2025-12-03 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d18d05ee-ec23-5d7d-a934-0de11d66656d with scrape type 2
2025-12-03 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d18d05ee-ec23-5d7d-a934-0de11d66656d with scrape type 2
2025-12-03 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d18d05ee-ec23-5d7d-a934-0de11d66656d, identifier: 116831329
2025-12-03 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 73c1087c-3679-517d-9aca-e2e22933a243 with identifier: 117238218
2025-12-03 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 73c1087c-3679-517d-9aca-e2e22933a243 with identifier: 117238218
2025-12-03 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 73c1087c-3679-517d-9aca-e2e22933a243 with identifier: 117238218 to the API
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2773c1087c-3679-517d-9aca-e2e22933a243%27 HTTP/1.1" 200 None
2025-12-03 19:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 73c1087c-3679-517d-9aca-e2e22933a243: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117238218?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '73c1087c-3679-517d-9aca-e2e22933a243',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GF72VBO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117238218',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 24622,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON RWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'RWD 4dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238218%27 HTTP/1.1" 200 None
2025-12-03 19:01:43 [astonbarclay.gb] INFO: Saving data for 117238218: {'auction_closing_time': 1764925200.0, 'created_time': 1763751641.580225, 'last_price_update_time': 1764788503.199417}
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117238218') HTTP/1.1" 204 0
2025-12-03 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104
2025-12-03 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104
2025-12-03 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104 to the API
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27349c4d6c-f50a-5e6d-bc25-c14445cedeac%27 HTTP/1.1" 200 None
2025-12-03 19:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 349c4d6c-f50a-5e6d-bc25-c14445cedeac: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117459104?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '349c4d6c-f50a-5e6d-bc25-c14445cedeac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FP72AZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117459104',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS HATCHBACK (RC)',
 'odometer': 15332,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'CITROEN C3 AIRCROSS HATCHBACK (RC) 1.2 PureTech 110 Shine 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 Shine 5dr',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459104%27 HTTP/1.1" 200 None
2025-12-03 19:01:43 [astonbarclay.gb] INFO: Saving data for 117459104: {'auction_closing_time': 1764925200.0, 'created_time': 1764356508.652316, 'last_price_update_time': 1764788503.502426}
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117459104') HTTP/1.1" 204 0
2025-12-03 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 118f7e90-81d8-5014-bf50-d437adee4c16 with identifier: 117725492
2025-12-03 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 118f7e90-81d8-5014-bf50-d437adee4c16 with identifier: 117725492
2025-12-03 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'startline motor finance ltd', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium se 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 43881, 'odometer_reading_unit': 'mi', 'registration_date': '2020-03-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117725492', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw premium se 38kwh 5dr auto', 'license_plate': 'hy20mwk', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '118f7e90-81d8-5014-bf50-d437adee4c16', 'current_year_diff': 5, 'age_in_months': 69, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 70619} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 69,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'electric',
     'id': '118f7e90-81d8-5014-bf50-d437adee4c16',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hy20mwk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117725492',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 43881,
     'odometer_in_km': 70619,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-01',
     'sanitized_make': 'hyundai',
     'seller_name': 'startline motor finance ltd',
     'title': 'hyundai ioniq electric hatchback 100kw premium se 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium se 38kwh 5dr auto',
     'vin': None,
     'year': 2020}
2025-12-03 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 118f7e90-81d8-5014-bf50-d437adee4c16 spider: astonbarclay.gb
2025-12-03 19:01:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 118f7e90-81d8-5014-bf50-d437adee4c16 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'startline motor finance ltd', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium se 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 43881, 'odometer_reading_unit': 'mi', 'registration_date': '2020-03-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117725492', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw premium se 38kwh 5dr auto', 'license_plate': 'hy20mwk', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '118f7e90-81d8-5014-bf50-d437adee4c16', 'current_year_diff': 5, 'age_in_months': 69, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 70619} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 69,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'electric',
     'id': '118f7e90-81d8-5014-bf50-d437adee4c16',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hy20mwk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117725492',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 43881,
     'odometer_in_km': 70619,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-01',
     'sanitized_make': 'hyundai',
     'seller_name': 'startline motor finance ltd',
     'title': 'hyundai ioniq electric hatchback 100kw premium se 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium se 38kwh 5dr auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '118f7e90-81d8-5014-bf50-d437adee4c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HY20MWK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117725492',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'IONIQ ELECTRIC HATCHBACK',
 'odometer': 43881,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'HYUNDAI IONIQ ELECTRIC HATCHBACK 100kW Premium SE 38kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Premium SE 38kWh 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117725492%27 HTTP/1.1" 200 None
2025-12-03 19:01:43 [astonbarclay.gb] INFO: Saving data for 117725492: {'created_time': 1764788503.716634, 'last_price_update_time': 1764788503.716644, 'auction_closing_time': 1765274400.0}
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117725492') HTTP/1.1" 204 0
2025-12-03 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d18d05ee-ec23-5d7d-a934-0de11d66656d with identifier: 116831329
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BEIGE HTTP/1.1" 200 None
2025-12-03 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d18d05ee-ec23-5d7d-a934-0de11d66656d with identifier: 116831329
2025-12-03 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra tavascan estate 210kw v1 77kwh 5dr auto [winter pack]', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'tavascan estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3998, 'odometer_reading_unit': 'mi', 'registration_date': '2025-03-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831329', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '210kw v1 77kwh 5dr auto [winter pack]', 'license_plate': 'kn25xyk', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd18d05ee-ec23-5d7d-a934-0de11d66656d', 'current_year_diff': 0, 'age_in_months': 8, 'make_model': 'cupra tavascan estate', 'sanitized_make': 'cupra', 'odometer_in_km': 6434} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 8,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'beige',
     'currency': 'gbp',
     'current_year_diff': 0,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd18d05ee-ec23-5d7d-a934-0de11d66656d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kn25xyk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831329',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'cupra',
     'make_model': 'cupra tavascan estate',
     'model': 'tavascan estate',
     'odometer': 3998,
     'odometer_in_km': 6434,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2025-03-14',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra tavascan estate 210kw v1 77kwh 5dr auto [winter pack]',
     'transmission': 'automatic',
     'trim': '210kw v1 77kwh 5dr auto [winter pack]',
     'vin': None,
     'year': 2025}
2025-12-03 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d18d05ee-ec23-5d7d-a934-0de11d66656d spider: astonbarclay.gb
2025-12-03 19:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d18d05ee-ec23-5d7d-a934-0de11d66656d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra tavascan estate 210kw v1 77kwh 5dr auto [winter pack]', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'tavascan estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3998, 'odometer_reading_unit': 'mi', 'registration_date': '2025-03-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831329', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '210kw v1 77kwh 5dr auto [winter pack]', 'license_plate': 'kn25xyk', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd18d05ee-ec23-5d7d-a934-0de11d66656d', 'current_year_diff': 0, 'age_in_months': 8, 'make_model': 'cupra tavascan estate', 'sanitized_make': 'cupra', 'odometer_in_km': 6434} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 8,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'beige',
     'currency': 'gbp',
     'current_year_diff': 0,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd18d05ee-ec23-5d7d-a934-0de11d66656d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kn25xyk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831329',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'cupra',
     'make_model': 'cupra tavascan estate',
     'model': 'tavascan estate',
     'odometer': 3998,
     'odometer_in_km': 6434,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2025-03-14',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra tavascan estate 210kw v1 77kwh 5dr auto [winter pack]',
     'transmission': 'automatic',
     'trim': '210kw v1 77kwh 5dr auto [winter pack]',
     'vin': None,
     'year': 2025}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BEIGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd18d05ee-ec23-5d7d-a934-0de11d66656d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KN25XYK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831329',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CUPRA',
 'model': 'TAVASCAN ESTATE',
 'odometer': 3998,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-14',
 'seller_name': 'Zenith',
 'title': 'CUPRA TAVASCAN ESTATE 210kW V1 77kWh 5dr Auto [Winter Pack]',
 'transmission': 'automatic',
 'trim': '210kW V1 77kWh 5dr Auto [Winter Pack]',
 'vin': None,
 'year': 2025}
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831329%27 HTTP/1.1" 200 None
2025-12-03 19:01:44 [astonbarclay.gb] INFO: Saving data for 116831329: {'auction_closing_time': 1764925200.0, 'created_time': 1763751913.171505, 'last_price_update_time': 1764788504.185297}
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116831329') HTTP/1.1" 204 0
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eccb810>
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252F9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb1bb50>
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252F22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1c890>
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fdc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/dc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8115d0>
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO66VXF%252F2025-12-03%252Fimage%252Fa57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d129c6d6-e3b1-561b-a574-2d6bb74cb558
2025-12-03 19:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d129c6d6-e3b1-561b-a574-2d6bb74cb558, skipping ID generation
2025-12-03 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d129c6d6-e3b1-561b-a574-2d6bb74cb558 with scrape type 1
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d129c6d6-e3b1-561b-a574-2d6bb74cb558 from tracking dictionaries
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d129c6d6-e3b1-561b-a574-2d6bb74cb558 sending to next pipeline
2025-12-03 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d129c6d6-e3b1-561b-a574-2d6bb74cb558, identifier: 117707935
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eeb47d0>
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Fef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/ef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a8c5f7ca-208d-4818-9429-5dbf86471457.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117708032?view=catalogue)
2025-12-03 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704752?view=catalogue)
2025-12-03 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117361961
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117361961%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117361961: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117345378
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117345378%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117345378: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117573049
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117573049: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117705864
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117705864%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117705864: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117551950
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117551950: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117550109
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117550109: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117672175
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672175%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117672175: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117374356
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374356%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117374356: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117638131
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638131%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117638131: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117471399
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117471399: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117491120
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491120%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117491120: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117664913
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664913%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117664913: 0
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117449793
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117449793%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117449793: 1
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d129c6d6-e3b1-561b-a574-2d6bb74cb558 with identifier: 117707935
2025-12-03 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d129c6d6-e3b1-561b-a574-2d6bb74cb558 with identifier: 117707935
2025-12-03 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d129c6d6-e3b1-561b-a574-2d6bb74cb558 with identifier: 117707935 to the API
2025-12-03 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'd129c6d6-e3b1-561b-a574-2d6bb74cb558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VO66VXF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707935',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA DIESEL SPORTS TOURER',
 'odometer': 92999,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35615,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/a57bc2ae-6f6e-41e3-952d-c7cd6e0a4142_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40527,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d3e4fd30-a9cf-4cca-bc42-d03a9e2177ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34721,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/879d8e1f-b397-472a-9d6a-72354ddedd36_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37160,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/d9d73dff-e9b2-4f07-9239-3f76570fd443_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54031,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/6acae049-d7fa-41fa-b887-1bc5d62b45a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57857,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/2416b406-0bb2-4d71-9f9b-e3cb9b07ac8b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41218,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/acb1c81f-608d-496c-b229-8e078e225634_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52547,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/9d2deebb-f8bf-45d5-9510-1ad3afc286bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d129c6d6-e3b1-561b-a574-2d6bb74cb558/d129c6d6-e3b1-561b-a574-2d6bb74cb558_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49236,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO66VXF/2025-12-03/image/dc647227-404e-4b73-847d-c3abfde1e989_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-31',
 'seller_name': 'CarGiant',
 'title': 'VAUXHALL ASTRA DIESEL SPORTS TOURER 1.6 CDTi 16V ecoFLEX Design 5dr',
 'transmission': 'manual',
 'trim': '1.6 CDTi 16V ecoFLEX Design 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707935%27 HTTP/1.1" 200 None
2025-12-03 19:01:46 [astonbarclay.gb] INFO: Saving data for 117707935: {'created_time': 1764788506.390085, 'last_price_update_time': 1764788506.390095, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117707935') HTTP/1.1" 204 0
2025-12-03 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117101013?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8da4d0>
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG16PGV%252F2025-12-03%252Fimage%252F78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG16PGV/2025-12-03/image/78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0656eb57-fe82-5758-80c6-9c94c5cb8791
2025-12-03 19:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0656eb57-fe82-5758-80c6-9c94c5cb8791, skipping ID generation
2025-12-03 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0656eb57-fe82-5758-80c6-9c94c5cb8791 with scrape type 1
2025-12-03 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0656eb57-fe82-5758-80c6-9c94c5cb8791 from tracking dictionaries
2025-12-03 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0656eb57-fe82-5758-80c6-9c94c5cb8791 sending to next pipeline
2025-12-03 19:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0656eb57-fe82-5758-80c6-9c94c5cb8791, identifier: 117704526
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f790ed0>
2025-12-03 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Fd9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/d9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/52fefe97-9e50-4cc0-a244-e10c4de30595.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117587813
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117587813%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117587813: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117666809
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666809%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117666809: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117543807
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543807%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117543807: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117610912
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610912%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117610912: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117425969
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425969%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117425969: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117603564
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603564%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117603564: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117672666
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672666%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117672666: 0
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117563903
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563903%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117563903: 1
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0656eb57-fe82-5758-80c6-9c94c5cb8791 with identifier: 117704526
2025-12-03 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0656eb57-fe82-5758-80c6-9c94c5cb8791 with identifier: 117704526
2025-12-03 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164204 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164204
2025-12-03 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0656eb57-fe82-5758-80c6-9c94c5cb8791 spider: astonbarclay.gb
2025-12-03 19:01:47 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0656eb57-fe82-5758-80c6-9c94c5cb8791 due to rule: high_mileage_for_country.json, error: 164204 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164204
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '0656eb57-fe82-5758-80c6-9c94c5cb8791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YG16PGV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117704526',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '5 SERIES DIESEL TOURING',
 'odometer': 102032,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33907,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/7b851ab7-0dad-444c-ad97-dc6bffdab16e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34604,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/fe718e3a-1dcd-4d88-90e1-6e8ffa8dd762_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34144,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/71f686eb-77ce-452a-b9b5-d09561b9071d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35768,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/a0bf1c04-5f29-4d74-9313-a5e396d6832b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58407,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/484db2d3-f1e0-4987-8f1e-1d6519553591_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54105,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/78c679f9-3e8d-4b36-b1a5-504520ddba38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79698,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/81ab43d9-2be4-45fe-b1b6-ebc774a25558_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48306,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/977ab1bf-6af4-4ee3-8df6-9dbf1bd8f99e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54329,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/b4168d25-eebc-4aae-88f2-6788a1dd6889_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/c799c677-b6f1-44a9-824e-0ab6e831325e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0656eb57-fe82-5758-80c6-9c94c5cb8791/0656eb57-fe82-5758-80c6-9c94c5cb8791_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58824,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG16PGV/2025-12-03/image/53e97dc2-4561-4a30-a266-92189c59cea4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': 'UKCGR - Select',
 'title': 'BMW 5 SERIES DIESEL TOURING 535d M Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '535d M Sport 5dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704526%27 HTTP/1.1" 200 None
2025-12-03 19:01:47 [astonbarclay.gb] INFO: Saving data for 117704526: {'created_time': 1764788507.528369, 'last_price_update_time': 1764788507.528378, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117704526') HTTP/1.1" 204 0
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed0ff10>
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa8c5f7ca-208d-4818-9429-5dbf86471457.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a8c5f7ca-208d-4818-9429-5dbf86471457.jpg?w=600 saved to cache
2025-12-03 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee6a490>
2025-12-03 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYT69UHZ%252F2025-12-03%252Fimage%252Fa577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d658bee-3528-5144-b65e-4886d6dd3af2
2025-12-03 19:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d658bee-3528-5144-b65e-4886d6dd3af2, skipping ID generation
2025-12-03 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d658bee-3528-5144-b65e-4886d6dd3af2 with scrape type 1
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1d658bee-3528-5144-b65e-4886d6dd3af2 from tracking dictionaries
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d658bee-3528-5144-b65e-4886d6dd3af2 sending to next pipeline
2025-12-03 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1d658bee-3528-5144-b65e-4886d6dd3af2, identifier: 117708032
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75e750>
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg?w=600 saved to cache
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f843bd0>
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF66KPY%252F2025-12-03%252Fimage%252Fa951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6
2025-12-03 19:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9ffbb60-6752-5e2f-9710-3f9860fec8a6, skipping ID generation
2025-12-03 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6 with scrape type 1
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f9ffbb60-6752-5e2f-9710-3f9860fec8a6 from tracking dictionaries
2025-12-03 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9ffbb60-6752-5e2f-9710-3f9860fec8a6 sending to next pipeline
2025-12-03 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f9ffbb60-6752-5e2f-9710-3f9860fec8a6, identifier: 117704752
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8429d0>
2025-12-03 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg?w=600 saved to cache
2025-12-03 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 117736341
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117736341%27 HTTP/1.1" 200 None
2025-12-03 19:01:49 [astonbarclay.gb] INFO: Scrape type for 117736341: 1
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252Fb7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/b7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1d658bee-3528-5144-b65e-4886d6dd3af2 with identifier: 117708032
2025-12-03 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1d658bee-3528-5144-b65e-4886d6dd3af2 with identifier: 117708032
2025-12-03 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1d658bee-3528-5144-b65e-4886d6dd3af2 with identifier: 117708032 to the API
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '1d658bee-3528-5144-b65e-4886d6dd3af2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YT69UHZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708032',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 32456,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39526,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/fbde6a0f-8bb6-424f-b18c-aa482fb55d84_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39787,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/2b4ff6c8-7566-4425-aa43-48358a6a3465_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32313,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/03fe6d7e-e463-4f7e-aec1-b762be7d0fd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36770,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/5189bb0e-ff0c-48b9-b792-29dd700aeca5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46594,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/72217ffc-6fe0-4673-a123-971588a2e20e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53569,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/22b6d21f-d6ef-4619-a7c3-94220ea809c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43688,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/ef5e818e-e92e-4b8a-a69c-e9367482bce9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41560,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/d9c90556-03d4-4d03-aebd-473db948af1c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d658bee-3528-5144-b65e-4886d6dd3af2/1d658bee-3528-5144-b65e-4886d6dd3af2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38279,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YT69UHZ/2025-12-03/image/a577a026-8e6a-47cc-9f1f-be8d40459977_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seller_name': 'CarGiant',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T Visia 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Visia 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708032%27 HTTP/1.1" 200 None
2025-12-03 19:01:49 [astonbarclay.gb] INFO: Saving data for 117708032: {'created_time': 1764788509.598308, 'last_price_update_time': 1764788509.598318, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117708032') HTTP/1.1" 204 0
2025-12-03 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f9ffbb60-6752-5e2f-9710-3f9860fec8a6 with identifier: 117704752
2025-12-03 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f9ffbb60-6752-5e2f-9710-3f9860fec8a6 with identifier: 117704752
2025-12-03 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f9ffbb60-6752-5e2f-9710-3f9860fec8a6 with identifier: 117704752 to the API
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'f9ffbb60-6752-5e2f-9710-3f9860fec8a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF66KPY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117704752',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LEXUS',
 'model': 'CT HATCHBACK',
 'odometer': 61983,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39166,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/ff2d8d6e-00cc-43cd-b76b-47a334deacb9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40893,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/5f4e3cb5-f83a-4447-a7b3-a177fadaec69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43638,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/b2cbb810-fdcb-4bd6-8bac-bbb76d0abc35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41568,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/a951073b-0073-465e-ac3d-2d42a91d9e06_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40065,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/48e4c88e-c37a-47ba-83d5-6ba6fba3cf54_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24689,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/23a68325-d18e-4faf-b97a-386d2d89f700_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42961,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/639ea639-4440-4462-9f9c-8dd4e1957e07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56026,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3add8ce0-a46d-4417-be5c-0e01c51a9289_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45992,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/9d78dd7f-a254-442c-890b-21b57cce7ad4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ffbb60-6752-5e2f-9710-3f9860fec8a6/f9ffbb60-6752-5e2f-9710-3f9860fec8a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54263,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF66KPY/2025-12-03/image/3165e07a-9b79-4bd2-a5ce-afbe07a7cd16_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'UKCGR - Select',
 'title': 'LEXUS CT HATCHBACK 200h 1.8 F-Sport 5dr CVT Auto',
 'transmission': 'automatic',
 'trim': '200h 1.8 F-Sport 5dr CVT Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704752%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Saving data for 117704752: {'created_time': 1764788510.014486, 'last_price_update_time': 1764788510.014495, 'auction_closing_time': 1765215000.0}
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117704752') HTTP/1.1" 204 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117101013, 'registration': 'KY23TJO', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V1 58kWh 5dr Auto', 'mileage': 49097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-03', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY23TJO/2025-11-17/image/401a0749-2901-491d-98ef-2a9f5ddeb62a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/72cc07da-2d04-4b70-8d62-81ab80124986_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/db7278ea-796c-497f-b79e-5e8b22fe157c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/c6409cd6-0cc1-433b-ad71-e973e4c2e8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/af690961-7785-42f7-b4e2-f52f9ccd6dfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/fe8b446a-5c80-4548-a7f2-4701bfcaa842_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/bcaf8416-89ac-4833-95bf-292e71ebe996_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/30c2eb74-09b2-43ac-8c03-7e5df59ddc00_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/64173795-52d8-43f9-8a4e-e06b8adb0954_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/f880e452-e2d5-483c-85a4-0417ba86b326_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 2/25 36k', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f91d95bb-f007-4acc-bc28-1acc47779666.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117101013, 'registration': 'KY23TJO', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V1 58kWh 5dr Auto', 'mileage': 49097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-03', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY23TJO/2025-11-17/image/401a0749-2901-491d-98ef-2a9f5ddeb62a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/72cc07da-2d04-4b70-8d62-81ab80124986_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/db7278ea-796c-497f-b79e-5e8b22fe157c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/c6409cd6-0cc1-433b-ad71-e973e4c2e8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/af690961-7785-42f7-b4e2-f52f9ccd6dfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/fe8b446a-5c80-4548-a7f2-4701bfcaa842_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/bcaf8416-89ac-4833-95bf-292e71ebe996_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/30c2eb74-09b2-43ac-8c03-7e5df59ddc00_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/64173795-52d8-43f9-8a4e-e06b8adb0954_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY23TJO/2025-11-17/image/f880e452-e2d5-483c-85a4-0417ba86b326_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 2/25 36k', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f91d95bb-f007-4acc-bc28-1acc47779666.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26771786-abda-50dc-82f7-fecc0fcc5901 with identifier: 117101013
2025-12-03 19:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26771786-abda-50dc-82f7-fecc0fcc5901 with scrape type 2
2025-12-03 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26771786-abda-50dc-82f7-fecc0fcc5901 with scrape type 2
2025-12-03 19:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 26771786-abda-50dc-82f7-fecc0fcc5901, identifier: 117101013
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9096e418-08e9-4699-acbe-d1897d9b14c9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 26771786-abda-50dc-82f7-fecc0fcc5901 with identifier: 117101013
2025-12-03 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 26771786-abda-50dc-82f7-fecc0fcc5901 with identifier: 117101013
2025-12-03 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 49097, 'odometer_reading_unit': 'mi', 'registration_date': '2023-03-03', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101013', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '150kw v1 58kwh 5dr auto', 'license_plate': 'ky23tjo', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '26771786-abda-50dc-82f7-fecc0fcc5901', 'current_year_diff': 2, 'age_in_months': 33, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 79013} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '26771786-abda-50dc-82f7-fecc0fcc5901',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ky23tjo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101013',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 49097,
     'odometer_in_km': 79013,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-03-03',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v1 58kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-03 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 26771786-abda-50dc-82f7-fecc0fcc5901 spider: astonbarclay.gb
2025-12-03 19:01:50 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 26771786-abda-50dc-82f7-fecc0fcc5901 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 49097, 'odometer_reading_unit': 'mi', 'registration_date': '2023-03-03', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101013', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '150kw v1 58kwh 5dr auto', 'license_plate': 'ky23tjo', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '26771786-abda-50dc-82f7-fecc0fcc5901', 'current_year_diff': 2, 'age_in_months': 33, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 79013} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '26771786-abda-50dc-82f7-fecc0fcc5901',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ky23tjo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101013',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 49097,
     'odometer_in_km': 79013,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-03-03',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v1 58kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '26771786-abda-50dc-82f7-fecc0fcc5901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KY23TJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101013',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 49097,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-03',
 'seller_name': 'Zenith',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V1 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V1 58kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101013%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Saving data for 117101013: {'auction_closing_time': 1764925200.0, 'created_time': 1763751981.845637, 'last_price_update_time': 1764788510.325916}
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117101013') HTTP/1.1" 204 0
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117374439
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374439%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117374439: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117631028
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631028%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117631028: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117507292
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507292%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117507292: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 116997754
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997754%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 116997754: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117606946
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117606946%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117606946: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117293082
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117293082: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117719094
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117719094%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117719094: 1
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117049908?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116988436?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117188762?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405887?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117544347?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117642793?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f891790>
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F52fefe97-9e50-4cc0-a244-e10c4de30595.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/52fefe97-9e50-4cc0-a244-e10c4de30595.jpg?w=600 saved to cache
2025-12-03 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117563927
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563927%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117563927: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117323884
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117323884: 0
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117563937
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563937%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117563937: 1
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f74af10>
2025-12-03 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1ae10>
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9096e418-08e9-4699-acbe-d1897d9b14c9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9096e418-08e9-4699-acbe-d1897d9b14c9.jpg?w=600 saved to cache
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb1b450>
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117049908, 'registration': 'YH72FVC', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q3 ESTATE', 'derivative': '45 TFSI e Technik 5dr S Tronic [Comfort+Sound Pk]', 'mileage': 77526, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-02', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-01', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YH72FVC/2025-11-10/image/a0260e97-b632-4fa6-a28c-4457e510001c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/c9468a20-829f-4882-b02c-72638ebaff4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/5c3b9d75-8e1e-4c54-a45a-5740f3748a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/7d6f5655-90d7-4aa4-956f-e1805aa11e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/688604bd-2485-4259-925a-16d3bcd623fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/ebcdb57f-2217-4b71-ab2a-f9cda2c9d7a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/ff17c4d7-d1a3-4acf-b849-86a1e534a45a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/c20a51cf-442c-47c9-9abe-64886783e7ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/f218034c-5a58-45c5-88e6-132fa00dfc71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/d7657516-4387-4bd2-8ab9-00b11b4ad2b1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 3/23 10K, 8/23 19K, 5/24 40K, 2/25 58K, 11/25 77K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9137af57-7327-498d-b1df-6135b36e062f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117049908, 'registration': 'YH72FVC', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q3 ESTATE', 'derivative': '45 TFSI e Technik 5dr S Tronic [Comfort+Sound Pk]', 'mileage': 77526, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-02', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-01', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YH72FVC/2025-11-10/image/a0260e97-b632-4fa6-a28c-4457e510001c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/c9468a20-829f-4882-b02c-72638ebaff4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/5c3b9d75-8e1e-4c54-a45a-5740f3748a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/7d6f5655-90d7-4aa4-956f-e1805aa11e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/688604bd-2485-4259-925a-16d3bcd623fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/ebcdb57f-2217-4b71-ab2a-f9cda2c9d7a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/ff17c4d7-d1a3-4acf-b849-86a1e534a45a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/c20a51cf-442c-47c9-9abe-64886783e7ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/f218034c-5a58-45c5-88e6-132fa00dfc71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH72FVC/2025-11-10/image/d7657516-4387-4bd2-8ab9-00b11b4ad2b1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 3/23 10K, 8/23 19K, 5/24 40K, 2/25 58K, 11/25 77K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9137af57-7327-498d-b1df-6135b36e062f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a9310f-7519-5607-9c6a-5e76a2334828 with identifier: 117049908
2025-12-03 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a9310f-7519-5607-9c6a-5e76a2334828 with scrape type 2
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a9310f-7519-5607-9c6a-5e76a2334828 with scrape type 2
2025-12-03 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87a9310f-7519-5607-9c6a-5e76a2334828, identifier: 117049908
2025-12-03 19:01:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116988436, 'registration': 'AO72NXH', 'account': 'ZEN002', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '400kW M50 83.9kWh 5dr Auto', 'mileage': 41978, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Electric', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO72NXH/2025-11-10/image/777d53b1-75bb-4ead-a26f-6bf55d58ee9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/54488ddd-a9ed-49a8-a710-d4cb3290898f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/5c91529d-a6e2-4dc2-a503-4620559d186d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/578494b5-eacb-4844-a770-1c820f3dfa67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/c7f40ba9-a57f-465f-9b26-46584bddc29e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/5ebbc613-267c-4cfc-9f48-ffa88f9b7b1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/e16783eb-507b-4698-9504-ea8a13d990ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/696da611-2685-4e62-a19f-9e12985e1b2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/516fc78a-f735-4758-984d-9ac6e2439b0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/020bd5ca-b084-4dc0-987d-f6aa8ae3abe7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/c77c5531-8f28-4c88-bac5-6c9bd4f394ef_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital iDRIVE @ 10/24 26K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1f0c3a2-74ee-4788-bccc-53109a52994c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116988436, 'registration': 'AO72NXH', 'account': 'ZEN002', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '400kW M50 83.9kWh 5dr Auto', 'mileage': 41978, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Electric', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO72NXH/2025-11-10/image/777d53b1-75bb-4ead-a26f-6bf55d58ee9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/54488ddd-a9ed-49a8-a710-d4cb3290898f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/5c91529d-a6e2-4dc2-a503-4620559d186d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/578494b5-eacb-4844-a770-1c820f3dfa67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/c7f40ba9-a57f-465f-9b26-46584bddc29e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/5ebbc613-267c-4cfc-9f48-ffa88f9b7b1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/e16783eb-507b-4698-9504-ea8a13d990ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/696da611-2685-4e62-a19f-9e12985e1b2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/516fc78a-f735-4758-984d-9ac6e2439b0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/020bd5ca-b084-4dc0-987d-f6aa8ae3abe7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72NXH/2025-11-10/image/c77c5531-8f28-4c88-bac5-6c9bd4f394ef_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital iDRIVE @ 10/24 26K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1f0c3a2-74ee-4788-bccc-53109a52994c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76bf8e52-14c2-55b3-8b21-44d442f9083d with identifier: 116988436
2025-12-03 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76bf8e52-14c2-55b3-8b21-44d442f9083d with scrape type 2
2025-12-03 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76bf8e52-14c2-55b3-8b21-44d442f9083d with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 76bf8e52-14c2-55b3-8b21-44d442f9083d, identifier: 116988436
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117188762, 'registration': 'VK71UUM', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S/Tech Pack]', 'mileage': 70196, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-10-25', 'fuel': 'Electric', 'motExpiry': '2026-10-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VK71UUM/2025-11-19/image/cc8cce81-30d4-417d-a69f-c07f4074a22e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c169ef77-5d05-4842-b5c0-80fd5580c6dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/ff90d159-83ec-43d8-be46-25c6ff802eb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c7dab8b8-a982-4b18-857f-15f7554ba3ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/3280728d-5c84-443e-a2e7-3ca906444f17_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c6e7e927-5a2c-4579-8205-b6f70483bf95_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/72314af2-9602-4eea-b7dd-826b84d0f1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c3ec1878-d875-4478-bf0a-0c1f60c8907b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/21c8d1eb-680f-44c9-864b-e8be25462dc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/f1199b9b-e10c-400e-982e-3edc0b7b9f2b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23 30K, 10/24 40K,', 'remarks': 'S/KEY (Blade Missing)', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aecd757c-a7be-4fb7-85fd-61132f498c77.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117188762, 'registration': 'VK71UUM', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S/Tech Pack]', 'mileage': 70196, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-10-25', 'fuel': 'Electric', 'motExpiry': '2026-10-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VK71UUM/2025-11-19/image/cc8cce81-30d4-417d-a69f-c07f4074a22e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c169ef77-5d05-4842-b5c0-80fd5580c6dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/ff90d159-83ec-43d8-be46-25c6ff802eb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c7dab8b8-a982-4b18-857f-15f7554ba3ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/3280728d-5c84-443e-a2e7-3ca906444f17_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c6e7e927-5a2c-4579-8205-b6f70483bf95_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/72314af2-9602-4eea-b7dd-826b84d0f1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/c3ec1878-d875-4478-bf0a-0c1f60c8907b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/21c8d1eb-680f-44c9-864b-e8be25462dc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK71UUM/2025-11-19/image/f1199b9b-e10c-400e-982e-3edc0b7b9f2b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23 30K, 10/24 40K,', 'remarks': 'S/KEY (Blade Missing)', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aecd757c-a7be-4fb7-85fd-61132f498c77.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fcb8485-650d-563e-b669-4c216826015c with identifier: 117188762
2025-12-03 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fcb8485-650d-563e-b669-4c216826015c with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fcb8485-650d-563e-b669-4c216826015c with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7fcb8485-650d-563e-b669-4c216826015c, identifier: 117188762
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117405887, 'registration': 'BK23DJY', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport Pro 80kWh 5dr Auto', 'mileage': 66762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-09', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3b7ac164-9e84-4926-8a1f-febf463175e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/fd664b08-7e4c-42db-b0fe-03cd20cf176d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/8e0a4cdb-5865-4a72-bbd3-0523f39cdef4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0f80c40d-98f8-4034-88fa-69bf08067aa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0e6f7f84-d3a4-4797-8755-63fe3539c332_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3994643a-8bb9-4777-a2a1-a8f3db3fbf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/36812a72-8697-4075-b730-2727e7852fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/44c111e2-7eab-47a7-902a-759af7a44cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/1bd2c547-f9e4-46d1-8830-38f350889713_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/d34d1d46-a7b3-4122-a0de-fe03d164adcd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital iDRIVE @ 2/25 49K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e0abf01-a0d4-45f8-bf04-3b490417136d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117405887, 'registration': 'BK23DJY', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport Pro 80kWh 5dr Auto', 'mileage': 66762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-09', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3b7ac164-9e84-4926-8a1f-febf463175e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/fd664b08-7e4c-42db-b0fe-03cd20cf176d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/8e0a4cdb-5865-4a72-bbd3-0523f39cdef4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0f80c40d-98f8-4034-88fa-69bf08067aa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0e6f7f84-d3a4-4797-8755-63fe3539c332_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3994643a-8bb9-4777-a2a1-a8f3db3fbf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/36812a72-8697-4075-b730-2727e7852fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/44c111e2-7eab-47a7-902a-759af7a44cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/1bd2c547-f9e4-46d1-8830-38f350889713_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/d34d1d46-a7b3-4122-a0de-fe03d164adcd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital iDRIVE @ 2/25 49K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e0abf01-a0d4-45f8-bf04-3b490417136d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with identifier: 117405887
2025-12-03 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ca8f9727-c9b2-5930-b59c-a27038a9f8f4, identifier: 117405887
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605544, 'registration': 'AJ66XFA', 'account': 'THE109', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d Portfolio 5dr Auto AWD', 'mileage': 78461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-06', 'fuel': 'Diesel', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dac9434e-8459-439a-b9a5-5091da5fb207.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605544, 'registration': 'AJ66XFA', 'account': 'THE109', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d Portfolio 5dr Auto AWD', 'mileage': 78461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-06', 'fuel': 'Diesel', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dac9434e-8459-439a-b9a5-5091da5fb207.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2 with identifier: 117605544
2025-12-03 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2 with scrape type 1
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2
2025-12-03 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2, identifier: 117605544
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117544347, 'registration': 'KP23PXT', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V3 58kWh 5dr Auto', 'mileage': 36615, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-29', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP23PXT/2025-11-27/image/47cb73a4-4062-45aa-848b-857ebc10bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/e08124cf-1b4a-41bd-bb86-4db623dbb9cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/a9f0e7dc-1eb2-443f-b0e5-2b1164572f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/8b9b6d7c-9f90-445e-83be-74932678e911_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/83e125da-5cba-44a2-9698-0080e1f563bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/fa198d6d-3968-4293-bd6f-3e1134ed9683_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/86168a3b-5b08-40c2-9196-1d9a163d95d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/bca09a0e-a1e5-4420-a48f-b35c2025e74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/801757b8-9d06-47f8-ae08-97e97a527446_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/44989f7d-97a8-4d55-95b0-831f028f5e63_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ee37453-ce84-4122-acc2-d2f453301b3a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117544347, 'registration': 'KP23PXT', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V3 58kWh 5dr Auto', 'mileage': 36615, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-05T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-29', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP23PXT/2025-11-27/image/47cb73a4-4062-45aa-848b-857ebc10bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/e08124cf-1b4a-41bd-bb86-4db623dbb9cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/a9f0e7dc-1eb2-443f-b0e5-2b1164572f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/8b9b6d7c-9f90-445e-83be-74932678e911_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/83e125da-5cba-44a2-9698-0080e1f563bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/fa198d6d-3968-4293-bd6f-3e1134ed9683_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/86168a3b-5b08-40c2-9196-1d9a163d95d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/bca09a0e-a1e5-4420-a48f-b35c2025e74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/801757b8-9d06-47f8-ae08-97e97a527446_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/44989f7d-97a8-4d55-95b0-831f028f5e63_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ee37453-ce84-4122-acc2-d2f453301b3a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with identifier: 117544347
2025-12-03 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with scrape type 2
2025-12-03 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb, identifier: 117544347
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117642793, 'registration': 'BD22ZRE', 'account': 'DAY005', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon 5dr CVT', 'mileage': 36012, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-05-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-29', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/92506f83-710e-4fb7-bcc2-5b5436e19c81.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117642793, 'registration': 'BD22ZRE', 'account': 'DAY005', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon 5dr CVT', 'mileage': 36012, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-05-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-29', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/92506f83-710e-4fb7-bcc2-5b5436e19c81.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5 with identifier: 117642793
2025-12-03 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5 with scrape type 1
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5
2025-12-03 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5, identifier: 117642793
2025-12-03 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/b7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117374304
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374304%27 HTTP/1.1" 200 None
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117374304: 0
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117729380
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117729380%27 HTTP/1.1" 200 None
2025-12-03 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117729380: 1
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87a9310f-7519-5607-9c6a-5e76a2334828 with identifier: 117049908
2025-12-03 19:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87a9310f-7519-5607-9c6a-5e76a2334828 with identifier: 117049908
2025-12-03 19:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 87a9310f-7519-5607-9c6a-5e76a2334828 with identifier: 117049908 to the API
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117049908?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '87a9310f-7519-5607-9c6a-5e76a2334828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YH72FVC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117049908',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'Q3 ESTATE',
 'odometer': 77526,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-02',
 'seller_name': 'Zenith',
 'title': 'AUDI Q3 ESTATE 45 TFSI e Technik 5dr S Tronic [Comfort+Sound Pk]',
 'transmission': 'automatic',
 'trim': '45 TFSI e Technik 5dr S Tronic [Comfort+Sound Pk]',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049908%27 HTTP/1.1" 200 None
2025-12-03 19:01:53 [astonbarclay.gb] INFO: Saving data for 117049908: {'auction_closing_time': 1764925200.0, 'created_time': 1763147266.036468, 'last_price_update_time': 1764788513.039084}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117049908') HTTP/1.1" 204 0
2025-12-03 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 76bf8e52-14c2-55b3-8b21-44d442f9083d with identifier: 116988436
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 76bf8e52-14c2-55b3-8b21-44d442f9083d with identifier: 116988436
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 41978, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988436', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '400kw m50 83.9kwh 5dr auto', 'license_plate': 'ao72nxh', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '76bf8e52-14c2-55b3-8b21-44d442f9083d', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 67556} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '76bf8e52-14c2-55b3-8b21-44d442f9083d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao72nxh',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988436',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 41978,
     'odometer_in_km': 67556,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-08',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '400kw m50 83.9kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 76bf8e52-14c2-55b3-8b21-44d442f9083d spider: astonbarclay.gb
2025-12-03 19:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 76bf8e52-14c2-55b3-8b21-44d442f9083d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 41978, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988436', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '400kw m50 83.9kwh 5dr auto', 'license_plate': 'ao72nxh', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '76bf8e52-14c2-55b3-8b21-44d442f9083d', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 67556} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '76bf8e52-14c2-55b3-8b21-44d442f9083d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao72nxh',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988436',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 41978,
     'odometer_in_km': 67556,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-08',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '400kw m50 83.9kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '76bf8e52-14c2-55b3-8b21-44d442f9083d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO72NXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988436',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': 'I4 GRAN COUPE',
 'odometer': 41978,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seller_name': 'Zenith',
 'title': 'BMW I4 GRAN COUPE 400kW M50 83.9kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '400kW M50 83.9kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988436%27 HTTP/1.1" 200 None
2025-12-03 19:01:53 [astonbarclay.gb] INFO: Saving data for 116988436: {'auction_closing_time': 1764925200.0, 'created_time': 1763146932.100628, 'last_price_update_time': 1764788513.36171}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116988436') HTTP/1.1" 204 0
2025-12-03 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7fcb8485-650d-563e-b669-4c216826015c with identifier: 117188762
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7fcb8485-650d-563e-b669-4c216826015c with identifier: 117188762
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 70196, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117188762', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'license_plate': 'vk71uum', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7fcb8485-650d-563e-b669-4c216826015c', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 112969} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '7fcb8485-650d-563e-b669-4c216826015c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vk71uum',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117188762',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 70196,
     'odometer_in_km': 112969,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-25',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto '
              '[c+s/tech pack]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]',
     'vin': None,
     'year': 2021}
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 7fcb8485-650d-563e-b669-4c216826015c spider: astonbarclay.gb
2025-12-03 19:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7fcb8485-650d-563e-b669-4c216826015c due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 70196, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117188762', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'license_plate': 'vk71uum', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7fcb8485-650d-563e-b669-4c216826015c', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 112969} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '7fcb8485-650d-563e-b669-4c216826015c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vk71uum',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117188762',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 70196,
     'odometer_in_km': 112969,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-25',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto '
              '[c+s/tech pack]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '7fcb8485-650d-563e-b669-4c216826015c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VK71UUM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117188762',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 70196,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto [C+S/Tech '
          'Pack]',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh S Line 5dr Auto [C+S/Tech Pack]',
 'vin': None,
 'year': 2021}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188762%27 HTTP/1.1" 200 None
2025-12-03 19:01:53 [astonbarclay.gb] INFO: Saving data for 117188762: {'auction_closing_time': 1764925200.0, 'created_time': 1763752001.06079, 'last_price_update_time': 1764788513.597691}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117188762') HTTP/1.1" 204 0
2025-12-03 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with identifier: 117405887
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with identifier: 117405887
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 66762, 'odometer_reading_unit': 'mi', 'registration_date': '2023-03-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405887', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '210kw m sport pro 80kwh 5dr auto', 'license_plate': 'bk23djy', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ca8f9727-c9b2-5930-b59c-a27038a9f8f4', 'current_year_diff': 2, 'age_in_months': 32, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 107442} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': 'ca8f9727-c9b2-5930-b59c-a27038a9f8f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bk23djy',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405887',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 66762,
     'odometer_in_km': 107442,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-03-09',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport pro 80kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 spider: astonbarclay.gb
2025-12-03 19:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 66762, 'odometer_reading_unit': 'mi', 'registration_date': '2023-03-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405887', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '210kw m sport pro 80kwh 5dr auto', 'license_plate': 'bk23djy', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ca8f9727-c9b2-5930-b59c-a27038a9f8f4', 'current_year_diff': 2, 'age_in_months': 32, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 107442} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': 'ca8f9727-c9b2-5930-b59c-a27038a9f8f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bk23djy',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405887',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 66762,
     'odometer_in_km': 107442,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-03-09',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport pro 80kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ca8f9727-c9b2-5930-b59c-a27038a9f8f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK23DJY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405887',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': 'iX3 ELECTRIC ESTATE',
 'odometer': 66762,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seller_name': 'Zenith',
 'title': 'BMW iX3 ELECTRIC ESTATE 210kW M Sport Pro 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW M Sport Pro 80kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405887%27 HTTP/1.1" 200 None
2025-12-03 19:01:53 [astonbarclay.gb] INFO: Saving data for 117405887: {'auction_closing_time': 1764925200.0, 'created_time': 1764356708.800155, 'last_price_update_time': 1764788513.827609}
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405887') HTTP/1.1" 204 0
2025-12-03 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2 with identifier: 117605544
2025-12-03 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2 with identifier: 117605544
2025-12-03 19:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2 with identifier: 117605544 to the API
2025-12-03 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2731e74bb9-9b42-5d4a-bc5b-cb28347c13d2%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117605544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '31e74bb9-9b42-5d4a-bc5b-cb28347c13d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AJ66XFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605544',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'JAGUAR',
 'model': 'F-PACE DIESEL ESTATE',
 'odometer': 78461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-06',
 'seller_name': 'TCB Group - Prime',
 'title': 'JAGUAR F-PACE DIESEL ESTATE 2.0d Portfolio 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '2.0d Portfolio 5dr Auto AWD',
 'vin': None,
 'year': 2016}
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605544%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Saving data for 117605544: {'created_time': 1764788514.130424, 'last_price_update_time': 1764788514.130434, 'auction_closing_time': 1765274400.0}
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605544') HTTP/1.1" 204 0
2025-12-03 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with identifier: 117544347
2025-12-03 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with identifier: 117544347
2025-12-03 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v3 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 36615, 'odometer_reading_unit': 'mi', 'registration_date': '2023-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544347', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '150kw v3 58kwh 5dr auto', 'license_plate': 'kp23pxt', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb', 'current_year_diff': 2, 'age_in_months': 32, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 58925} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': 'af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kp23pxt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544347',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 36615,
     'odometer_in_km': 58925,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-03-29',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra born electric hatchback 150kw v3 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v3 58kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-03 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb spider: astonbarclay.gb
2025-12-03 19:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v3 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 36615, 'odometer_reading_unit': 'mi', 'registration_date': '2023-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544347', 'expiration_date': '2025-12-05t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '150kw v3 58kwh 5dr auto', 'license_plate': 'kp23pxt', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb', 'current_year_diff': 2, 'age_in_months': 32, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 58925} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': 'af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kp23pxt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544347',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 36615,
     'odometer_in_km': 58925,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-03-29',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra born electric hatchback 150kw v3 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v3 58kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KP23PXT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544347',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 36615,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': 'Zenith',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V3 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V3 58kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544347%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Saving data for 117544347: {'auction_closing_time': 1764925200.0, 'created_time': 1764356704.536813, 'last_price_update_time': 1764788514.369746}
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117544347') HTTP/1.1" 204 0
2025-12-03 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5 with identifier: 117642793
2025-12-03 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5 with identifier: 117642793
2025-12-03 19:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5 with identifier: 117642793 to the API
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2730535d7e-2fe9-50c6-b8b2-75edbafdd4e5%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 30535d7e-2fe9-50c6-b8b2-75edbafdd4e5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:01:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117642793?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '30535d7e-2fe9-50c6-b8b2-75edbafdd4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BD22ZRE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117642793',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORT',
 'odometer': 36012,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seller_name': 'Days Fleet',
 'title': 'TOYOTA COROLLA TOURING SPORT 1.8 VVT-i Hybrid Icon 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 VVT-i Hybrid Icon 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642793%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Saving data for 117642793: {'created_time': 1764788514.689611, 'last_price_update_time': 1764788514.689625, 'auction_closing_time': 1765188000.0}
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117642793') HTTP/1.1" 204 0
2025-12-03 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117617912?view=catalogue)
2025-12-03 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/da8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117617912?view=catalogue)
2025-12-03 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117661902
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661902%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117661902: 0
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117702364
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702364%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117702364: 1
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252Fbf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/bf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed00250>
2025-12-03 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f752c10>
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252Fb7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/b7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 117677344
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117677344%27 HTTP/1.1" 200 None
2025-12-03 19:01:55 [astonbarclay.gb] INFO: Scrape type for 117677344: 1
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8bf850>
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7254ec63-695f-5f26-8ded-0de20ccd1515/7254ec63-695f-5f26-8ded-0de20ccd1515_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg?w=600 saved to cache
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7254ec63-695f-5f26-8ded-0de20ccd1515
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee9dfd0>
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fda8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/da8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg?w=600 saved to cache
2025-12-03 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee325d0>
2025-12-03 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7254ec63-695f-5f26-8ded-0de20ccd1515/7254ec63-695f-5f26-8ded-0de20ccd1515_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600 saved to cache
2025-12-03 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7254ec63-695f-5f26-8ded-0de20ccd1515
2025-12-03 19:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7254ec63-695f-5f26-8ded-0de20ccd1515, skipping ID generation
2025-12-03 19:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7254ec63-695f-5f26-8ded-0de20ccd1515 with scrape type 1
2025-12-03 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7254ec63-695f-5f26-8ded-0de20ccd1515 from tracking dictionaries
2025-12-03 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7254ec63-695f-5f26-8ded-0de20ccd1515 sending to next pipeline
2025-12-03 19:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7254ec63-695f-5f26-8ded-0de20ccd1515, identifier: 117617912
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f753d90>
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg?w=600 saved to cache
2025-12-03 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117664657?view=catalogue)
2025-12-03 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7254ec63-695f-5f26-8ded-0de20ccd1515 with identifier: 117617912
2025-12-03 19:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7254ec63-695f-5f26-8ded-0de20ccd1515 with identifier: 117617912
2025-12-03 19:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7254ec63-695f-5f26-8ded-0de20ccd1515 with identifier: 117617912 to the API
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7254ec63-695f-5f26-8ded-0de20ccd1515',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PN20SBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117617912',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'I10 HATCHBACK',
 'odometer': 29866,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 3,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7254ec63-695f-5f26-8ded-0de20ccd1515/7254ec63-695f-5f26-8ded-0de20ccd1515_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48057,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/c1cb5a8b-d27a-40cd-8c6d-88ae8ce3bc24.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7254ec63-695f-5f26-8ded-0de20ccd1515/7254ec63-695f-5f26-8ded-0de20ccd1515_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57446,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/4d5a6dc7-546e-4622-ab13-24b1bc4a921d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7254ec63-695f-5f26-8ded-0de20ccd1515/7254ec63-695f-5f26-8ded-0de20ccd1515_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45116,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/c3ed8e5e-fc7a-4332-980e-c230c95321a7.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-09',
 'seller_name': 'Vantage Motor Group',
 'title': 'HYUNDAI I10 HATCHBACK 1.0 MPi Premium 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPi Premium 5dr',
 'vin': None,
 'year': 2020}
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117617912%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Saving data for 117617912: {'created_time': 1764788517.042094, 'last_price_update_time': 1764788517.042106, 'auction_closing_time': 1764927900.0}
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117617912') HTTP/1.1" 204 0
2025-12-03 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117585302
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585302%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117585302: 2
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117740684, 'registration': 'DF23XWH', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 20489, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23XWH/2025-12-03/image/bf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/dedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/c8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/840d0bf5-774d-4876-ab6d-9c5fe2619d29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117740684, 'registration': 'DF23XWH', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 20489, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23XWH/2025-12-03/image/bf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/dedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/c8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/840d0bf5-774d-4876-ab6d-9c5fe2619d29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d1af40-2acf-5757-afee-5bfaa9c65465 with identifier: 117740684
2025-12-03 19:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d1af40-2acf-5757-afee-5bfaa9c65465 with scrape type 1
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fbf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/bf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117585132
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585132%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117585132: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117585347
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585347%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117585347: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117585141
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585141%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117585141: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117585166
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585166%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117585166: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117584960
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584960%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117584960: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117584951
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584951%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117584951: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117585151
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585151%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117585151: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117604347
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604347%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117604347: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117584969
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584969%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117584969: 0
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117724459
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117724459%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117724459: 1
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8aeb50>
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F97a4618d-9250-4588-8f85-208eb59f8d2c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600 saved to cache
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461
2025-12-03 19:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bcbb47e-c032-5cf4-8efa-1d62257ff461, skipping ID generation
2025-12-03 19:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461 with scrape type 1
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bcbb47e-c032-5cf4-8efa-1d62257ff461 from tracking dictionaries
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bcbb47e-c032-5cf4-8efa-1d62257ff461 sending to next pipeline
2025-12-03 19:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6bcbb47e-c032-5cf4-8efa-1d62257ff461, identifier: 117664657
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed179d0>
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252Fc68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee69f10>
2025-12-03 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba5590>
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:58 [astonbarclay.gb] INFO: Found listing with ID: 117679523
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679523%27 HTTP/1.1" 200 None
2025-12-03 19:01:58 [astonbarclay.gb] INFO: Scrape type for 117679523: 1
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fa4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6bcbb47e-c032-5cf4-8efa-1d62257ff461 with identifier: 117664657
2025-12-03 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6bcbb47e-c032-5cf4-8efa-1d62257ff461 with identifier: 117664657
2025-12-03 19:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6bcbb47e-c032-5cf4-8efa-1d62257ff461 with identifier: 117664657 to the API
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '6bcbb47e-c032-5cf4-8efa-1d62257ff461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NU20UYT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117664657',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'TUCSON DIESEL ESTATE',
 'odometer': 59388,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59298,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/25d19130-2e3c-4304-9576-8bdeca00bcd4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61811,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/97a4618d-9250-4588-8f85-208eb59f8d2c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38004,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/e3f0c3e4-1f9c-4ed9-873c-cef1a9c2f35f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54020,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/da8548aa-cd89-4ff6-9a13-e187ab152c4e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51766,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/9096e418-08e9-4699-acbe-d1897d9b14c9.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57841,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/52fefe97-9e50-4cc0-a244-e10c4de30595.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55572,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/a9bcbd35-91b1-4e6b-85de-ab86b9a068f4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59884,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/a8c5f7ca-208d-4818-9429-5dbf86471457.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60411,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/88676d9c-f130-45bb-9d0c-b68fb35257f5.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57635,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/21f49de6-bf33-45a6-9e1d-8371366083bb.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57429,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/95fb8986-5784-41e1-9f99-794d3d359f62.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55365,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/de2e3d2c-b118-460a-b7e6-9ccae1b97c21.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcbb47e-c032-5cf4-8efa-1d62257ff461/6bcbb47e-c032-5cf4-8efa-1d62257ff461_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58725,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/b35a8b51-d556-468e-9bf7-a580fe189445.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-26',
 'seller_name': 'Vantage Motor Group',
 'title': 'HYUNDAI TUCSON DIESEL ESTATE 1.6 CRDi 48V MHD SE Nav 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 CRDi 48V MHD SE Nav 5dr 2WD',
 'vin': None,
 'year': 2020}
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664657%27 HTTP/1.1" 200 None
2025-12-03 19:01:58 [astonbarclay.gb] INFO: Saving data for 117664657: {'created_time': 1764788518.895094, 'last_price_update_time': 1764788518.895103, 'auction_closing_time': 1764927900.0}
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117664657') HTTP/1.1" 204 0
2025-12-03 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG21GUV/2025-12-03/image/bf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711277?view=catalogue)
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Found listing with ID: 117733240
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117733240%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Scrape type for 117733240: 1
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fa9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec45750>
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252F4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Found listing with ID: 117444914
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444914%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Scrape type for 117444914: 2
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff5b350>
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG21GUV%252F2025-12-03%252Fimage%252Fbf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG21GUV/2025-12-03/image/bf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg?w=600 saved to cache
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67016abd-d880-54d0-8337-c8bcae532b52
2025-12-03 19:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67016abd-d880-54d0-8337-c8bcae532b52, skipping ID generation
2025-12-03 19:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67016abd-d880-54d0-8337-c8bcae532b52 with scrape type 1
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67016abd-d880-54d0-8337-c8bcae532b52 from tracking dictionaries
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67016abd-d880-54d0-8337-c8bcae532b52 sending to next pipeline
2025-12-03 19:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 67016abd-d880-54d0-8337-c8bcae532b52, identifier: 117711277
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Found listing with ID: 116896181
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116896181%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Scrape type for 116896181: 0
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Found listing with ID: 116891404
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891404%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [astonbarclay.gb] INFO: Scrape type for 116891404: 2
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fdedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/dedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 67016abd-d880-54d0-8337-c8bcae532b52 with identifier: 117711277
2025-12-03 19:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 67016abd-d880-54d0-8337-c8bcae532b52 with identifier: 117711277
2025-12-03 19:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169881 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169881
2025-12-03 19:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 67016abd-d880-54d0-8337-c8bcae532b52 spider: astonbarclay.gb
2025-12-03 19:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 67016abd-d880-54d0-8337-c8bcae532b52 due to rule: high_mileage_for_country.json, error: 169881 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169881
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '67016abd-d880-54d0-8337-c8bcae532b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LG21GUV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117711277',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 105560,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27971,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/463f7428-00e5-4b71-ad3e-75195a087ed3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29433,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/8c46566b-d83c-4e7e-ba25-8f1b9404249a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27631,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/1870f915-fce4-43a4-89d2-fb756b7dbe97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28242,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/b7fa3d92-7bab-4370-8dd9-4b0e811f1dca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45640,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/660ed7c1-b239-46fd-b3bd-ca6302febd49_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40691,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/465907f9-4223-4f8d-9e39-612b5c1a4053_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46865,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/4524d408-cbda-4e65-b11e-8eac550b89fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67016abd-d880-54d0-8337-c8bcae532b52/67016abd-d880-54d0-8337-c8bcae532b52_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46445,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG21GUV/2025-12-03/image/bf8dc1f5-10a1-4672-b5a8-38dc92eb03a6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Excite 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Excite 5dr DCT',
 'vin': None,
 'year': 2021}
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117711277%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Saving data for 117711277: {'created_time': 1764788520.03385, 'last_price_update_time': 1764788520.033861, 'auction_closing_time': 1765274400.0}
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117711277') HTTP/1.1" 204 0
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117599947
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599947%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117599947: 0
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117247051
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247051%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117247051: 2
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fc8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/c8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117639547?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117736341?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563903?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563844?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117721727
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117721727%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117721727: 1
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117599975
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599975%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117599975: 0
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117665271
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117665271%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117665271: 1
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed59a90>
2025-12-03 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fa4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117627838
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627838%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117627838: 0
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117637760
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117637760%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117637760: 1
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117639547, 'registration': 'YG70UMX', 'account': 'THE109', 'make': 'BMW', 'model': '3 SERIES TOURING SPECIAL EDITIONS', 'derivative': '320d MHT M Sport Plus Edition 5dr Step Auto', 'mileage': 77260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117639547, 'registration': 'YG70UMX', 'account': 'THE109', 'make': 'BMW', 'model': '3 SERIES TOURING SPECIAL EDITIONS', 'derivative': '320d MHT M Sport Plus Edition 5dr Step Auto', 'mileage': 77260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593 with identifier: 117639547
2025-12-03 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593 with scrape type 1
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593
2025-12-03 19:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593, identifier: 117639547
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681911, 'registration': 'FR03PKR', 'account': 'STA058', 'make': 'SEAT', 'model': 'IBIZA HATCHBACK', 'derivative': '1.0 SE Technology [EZ] 5dr', 'mileage': 88127, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FR03PKR/2025-12-02/image/900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/b1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/fb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c476c574-c562-4631-994e-f986d7126198.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681911, 'registration': 'FR03PKR', 'account': 'STA058', 'make': 'SEAT', 'model': 'IBIZA HATCHBACK', 'derivative': '1.0 SE Technology [EZ] 5dr', 'mileage': 88127, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FR03PKR/2025-12-02/image/900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/b1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/fb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c476c574-c562-4631-994e-f986d7126198.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e934fa08-d17b-5354-aa22-1c0dc470571a with identifier: 117681911
2025-12-03 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e934fa08-d17b-5354-aa22-1c0dc470571a with scrape type 1
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117736341, 'registration': 'NU72XSR', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'BAYON HATCHBACK', 'derivative': '1.0 TGDi 48V MHEV SE Connect 5dr DCT', 'mileage': 29430, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/23-6k 10/24-14k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117736341, 'registration': 'NU72XSR', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'BAYON HATCHBACK', 'derivative': '1.0 TGDi 48V MHEV SE Connect 5dr DCT', 'mileage': 29430, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/23-6k 10/24-14k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5643484d-c7af-55e8-b008-c254ce9de33b with identifier: 117736341
2025-12-03 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5643484d-c7af-55e8-b008-c254ce9de33b with scrape type 1
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5643484d-c7af-55e8-b008-c254ce9de33b
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5643484d-c7af-55e8-b008-c254ce9de33b
2025-12-03 19:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5643484d-c7af-55e8-b008-c254ce9de33b, identifier: 117736341
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579304, 'registration': 'LM70MRU', 'account': 'WEF001', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '150kW 4 64kWh 5dr Auto', 'mileage': 160680, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-10-19', 'fuel': 'Electric', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d2e9291-0683-4a74-89be-d8f726191aef.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579304, 'registration': 'LM70MRU', 'account': 'WEF001', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '150kW 4 64kWh 5dr Auto', 'mileage': 160680, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-10-19', 'fuel': 'Electric', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d2e9291-0683-4a74-89be-d8f726191aef.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92df268c-e093-5a2a-b3ca-abd702a89640 with identifier: 117579304
2025-12-03 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92df268c-e093-5a2a-b3ca-abd702a89640 with scrape type 1
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117609437, 'registration': 'WG71JZW', 'account': 'DAY005', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW Sport 80kWh 5dr Auto', 'mileage': 64079, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-19', 'fuel': 'Electric', 'motExpiry': '2026-12-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/326bd042-314e-4350-be38-4747ec3c9fcb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117609437, 'registration': 'WG71JZW', 'account': 'DAY005', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW Sport 80kWh 5dr Auto', 'mileage': 64079, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-19', 'fuel': 'Electric', 'motExpiry': '2026-12-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/326bd042-314e-4350-be38-4747ec3c9fcb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343205af-8224-572b-a93f-7342725c54cc with identifier: 117609437
2025-12-03 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343205af-8224-572b-a93f-7342725c54cc with scrape type 1
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563903, 'registration': 'SGZ2493', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 i-MMD Hybrid SR 5dr eCVT', 'mileage': 60200, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/21-11k 10/22-28k 11/23-44k 01/25-55k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563903, 'registration': 'SGZ2493', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 i-MMD Hybrid SR 5dr eCVT', 'mileage': 60200, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/21-11k 10/22-28k 11/23-44k 01/25-55k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c with identifier: 117563903
2025-12-03 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c with scrape type 1
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c
2025-12-03 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c
2025-12-03 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c, identifier: 117563903
2025-12-03 19:02:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563844, 'registration': 'BV23WMK', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.0 TCE 90 Techno 5dr', 'mileage': 23038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-03-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/24-8k 03/25-18k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563844, 'registration': 'BV23WMK', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.0 TCE 90 Techno 5dr', 'mileage': 23038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-03-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/24-8k 03/25-18k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167 with identifier: 117563844
2025-12-03 19:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167 with scrape type 1
2025-12-03 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167
2025-12-03 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167
2025-12-03 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167, identifier: 117563844
2025-12-03 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/dedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:02:01 [astonbarclay.gb] INFO: Found listing with ID: 117737945
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737945%27 HTTP/1.1" 200 None
2025-12-03 19:02:01 [astonbarclay.gb] INFO: Scrape type for 117737945: 1
2025-12-03 19:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593 with identifier: 117639547
2025-12-03 19:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593 with identifier: 117639547
2025-12-03 19:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593 with identifier: 117639547 to the API
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279690f1d6-b2eb-5bdd-ad5b-2a896c57c593%27 HTTP/1.1" 200 None
2025-12-03 19:02:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9690f1d6-b2eb-5bdd-ad5b-2a896c57c593: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117639547?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9690f1d6-b2eb-5bdd-ad5b-2a896c57c593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YG70UMX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117639547',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '3 SERIES TOURING SPECIAL EDITIONS',
 'odometer': 77260,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': 'TCB Group - Prime',
 'title': 'BMW 3 SERIES TOURING SPECIAL EDITIONS 320d MHT M Sport Plus Edition '
          '5dr Step Auto',
 'transmission': 'automatic',
 'trim': '320d MHT M Sport Plus Edition 5dr Step Auto',
 'vin': None,
 'year': 2020}
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639547%27 HTTP/1.1" 200 None
2025-12-03 19:02:01 [astonbarclay.gb] INFO: Saving data for 117639547: {'created_time': 1764788521.430202, 'last_price_update_time': 1764788521.430212, 'auction_closing_time': 1765274400.0}
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117639547') HTTP/1.1" 204 0
2025-12-03 19:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5643484d-c7af-55e8-b008-c254ce9de33b with identifier: 117736341
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2025-12-03 19:02:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5643484d-c7af-55e8-b008-c254ce9de33b with identifier: 117736341
2025-12-03 19:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5643484d-c7af-55e8-b008-c254ce9de33b with identifier: 117736341 to the API
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275643484d-c7af-55e8-b008-c254ce9de33b%27 HTTP/1.1" 200 None
2025-12-03 19:02:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5643484d-c7af-55e8-b008-c254ce9de33b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117736341?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '5643484d-c7af-55e8-b008-c254ce9de33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NU72XSR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117736341',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'BAYON HATCHBACK',
 'odometer': 29430,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI BAYON HATCHBACK 1.0 TGDi 48V MHEV SE Connect 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0 TGDi 48V MHEV SE Connect 5dr DCT',
 'vin': None,
 'year': 2022}
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117736341%27 HTTP/1.1" 200 None
2025-12-03 19:02:01 [astonbarclay.gb] INFO: Saving data for 117736341: {'created_time': 1764788521.986377, 'last_price_update_time': 1764788521.986387, 'auction_closing_time': 1765275300.0}
2025-12-03 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117736341') HTTP/1.1" 204 0
2025-12-03 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c with identifier: 117563903
2025-12-03 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c with identifier: 117563903
2025-12-03 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c with identifier: 117563903 to the API
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117563903?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '4e5ccbe1-00d5-5aac-a9dc-9aa4b06b7a5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SGZ2493',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563903',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 60200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': 'Motability Operations',
 'title': 'HONDA CR-V ESTATE 2.0 i-MMD Hybrid SR 5dr eCVT',
 'transmission': 'automatic',
 'trim': '2.0 i-MMD Hybrid SR 5dr eCVT',
 'vin': None,
 'year': 2020}
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563903%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [astonbarclay.gb] INFO: Saving data for 117563903: {'created_time': 1764788522.284329, 'last_price_update_time': 1764788522.284339, 'auction_closing_time': 1765275300.0}
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563903') HTTP/1.1" 204 0
2025-12-03 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167 with identifier: 117563844
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED%2FBLACK HTTP/1.1" 200 None
2025-12-03 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167 with identifier: 117563844
2025-12-03 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167 with identifier: 117563844 to the API
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277ebeffeb-ec64-5c16-87f0-13c5a2eeb167%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7ebeffeb-ec64-5c16-87f0-13c5a2eeb167: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117563844?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '7ebeffeb-ec64-5c16-87f0-13c5a2eeb167',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV23WMK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563844',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 23038,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-17',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT CAPTUR HATCHBACK 1.0 TCE 90 Techno 5dr',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 Techno 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563844%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [astonbarclay.gb] INFO: Saving data for 117563844: {'created_time': 1764788522.860325, 'last_price_update_time': 1764788522.860337, 'auction_closing_time': 1765275300.0}
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563844') HTTP/1.1" 204 0
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Fd59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/c8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:02:02 [astonbarclay.gb] INFO: Found listing with ID: 117599932
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599932%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [astonbarclay.gb] INFO: Scrape type for 117599932: 0
2025-12-03 19:02:02 [astonbarclay.gb] INFO: Found listing with ID: 117737913
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737913%27 HTTP/1.1" 200 None
2025-12-03 19:02:02 [astonbarclay.gb] INFO: Scrape type for 117737913: 1
2025-12-03 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117449793?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec31ad0>
2025-12-03 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed35190>
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fa9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117661933
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661933%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117661933: 0
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117600202
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600202%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117600202: 0
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117616509
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616509%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117616509: 0
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117610728
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610728%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117610728: 0
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117639048
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639048%27 HTTP/1.1" 200 None
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117639048: 0
2025-12-03 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117613099
2025-12-03 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613099%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117613099: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117366549
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366549%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117366549: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 116891417
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891417%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 116891417: 2
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9a0d0>
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fdedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/dedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117719094?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117729380?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 116288981
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116288981%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 116288981: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117547832
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547832%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117547832: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117585083
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585083%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117585083: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117547822
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547822%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117547822: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117699534
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699534%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117699534: 0
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117644920
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117644920%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117644920: 1
2025-12-03 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252Fb1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/b1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb29d90>
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fc8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/c8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117449793, 'registration': 'BK72GKA', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 17565, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-09-27', 'fuel': 'Petrol', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK72GKA/2025-11-24/image/67cafd44-4f32-4636-b182-895e813fe45d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/6e1ff096-e82f-49c6-85dd-9e5da8092fc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/cce77126-f282-4f4b-ba8e-c8ddf26b8ecc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/aef7541f-dc2b-4d31-a987-70db929d40a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/234a788b-e4f5-4296-9217-d2ab705e5013_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/390dca3c-60df-4e43-917a-eabe5cfe4f70_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/2107058b-0295-406f-8f1d-0e93697ceca9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ae3bed8c-c081-4677-9083-19c9763b2dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cf7b139-ff4e-4607-93f9-006415927146_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/475dfdcc-92b5-4ca1-9b5e-c6046266fcdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/22fa354b-284d-4bd2-9e8a-f3485c536954_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/0ec228b5-fac6-46f2-b6ee-306f6c7f51d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8fdf27bf-7a23-4945-a879-e6fcfd448e34_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d6a1a6ea-5a7e-427b-8d9b-60d67550fe9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d0482dd3-904e-4e6b-972a-6517439226e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ba024fed-8694-4fa9-812a-1cb3f9d00b19_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/5c6cf8dc-73c6-4ac6-823d-f8cc523df5dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/1372dbe4-e028-462f-a81d-3eb6cca87f5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/9479e83f-ffa4-4d6a-be8e-00066cd27efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cb5f423-dbef-488e-8445-0254e1dd5b99_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23- 6k, 10/25- 17k', 'remarks': 'vosa - 17k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/026abace-f95d-4735-a055-c0261e519bff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117449793, 'registration': 'BK72GKA', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 17565, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-09-27', 'fuel': 'Petrol', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK72GKA/2025-11-24/image/67cafd44-4f32-4636-b182-895e813fe45d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/6e1ff096-e82f-49c6-85dd-9e5da8092fc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/cce77126-f282-4f4b-ba8e-c8ddf26b8ecc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/aef7541f-dc2b-4d31-a987-70db929d40a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/234a788b-e4f5-4296-9217-d2ab705e5013_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/390dca3c-60df-4e43-917a-eabe5cfe4f70_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/2107058b-0295-406f-8f1d-0e93697ceca9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ae3bed8c-c081-4677-9083-19c9763b2dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cf7b139-ff4e-4607-93f9-006415927146_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/475dfdcc-92b5-4ca1-9b5e-c6046266fcdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/22fa354b-284d-4bd2-9e8a-f3485c536954_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/0ec228b5-fac6-46f2-b6ee-306f6c7f51d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8fdf27bf-7a23-4945-a879-e6fcfd448e34_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d6a1a6ea-5a7e-427b-8d9b-60d67550fe9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d0482dd3-904e-4e6b-972a-6517439226e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ba024fed-8694-4fa9-812a-1cb3f9d00b19_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/5c6cf8dc-73c6-4ac6-823d-f8cc523df5dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/1372dbe4-e028-462f-a81d-3eb6cca87f5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/9479e83f-ffa4-4d6a-be8e-00066cd27efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cb5f423-dbef-488e-8445-0254e1dd5b99_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23- 6k, 10/25- 17k', 'remarks': 'vosa - 17k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/026abace-f95d-4735-a055-c0261e519bff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9afa1b7-074b-5bce-bf36-32cd8f4e613e with identifier: 117449793
2025-12-03 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9afa1b7-074b-5bce-bf36-32cd8f4e613e with scrape type 1
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e9afa1b7-074b-5bce-bf36-32cd8f4e613e
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F67cafd44-4f32-4636-b182-895e813fe45d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/67cafd44-4f32-4636-b182-895e813fe45d_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F6e1ff096-e82f-49c6-85dd-9e5da8092fc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/6e1ff096-e82f-49c6-85dd-9e5da8092fc1_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252Fcce77126-f282-4f4b-ba8e-c8ddf26b8ecc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/cce77126-f282-4f4b-ba8e-c8ddf26b8ecc_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252Faef7541f-dc2b-4d31-a987-70db929d40a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/aef7541f-dc2b-4d31-a987-70db929d40a5_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F234a788b-e4f5-4296-9217-d2ab705e5013_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/234a788b-e4f5-4296-9217-d2ab705e5013_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F390dca3c-60df-4e43-917a-eabe5cfe4f70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/390dca3c-60df-4e43-917a-eabe5cfe4f70_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F2107058b-0295-406f-8f1d-0e93697ceca9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/2107058b-0295-406f-8f1d-0e93697ceca9_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252Fae3bed8c-c081-4677-9083-19c9763b2dc4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ae3bed8c-c081-4677-9083-19c9763b2dc4_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F8cf7b139-ff4e-4607-93f9-006415927146_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cf7b139-ff4e-4607-93f9-006415927146_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F475dfdcc-92b5-4ca1-9b5e-c6046266fcdd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/475dfdcc-92b5-4ca1-9b5e-c6046266fcdd_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F22fa354b-284d-4bd2-9e8a-f3485c536954_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/22fa354b-284d-4bd2-9e8a-f3485c536954_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F0ec228b5-fac6-46f2-b6ee-306f6c7f51d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/0ec228b5-fac6-46f2-b6ee-306f6c7f51d3_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F8fdf27bf-7a23-4945-a879-e6fcfd448e34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8fdf27bf-7a23-4945-a879-e6fcfd448e34_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252Fd6a1a6ea-5a7e-427b-8d9b-60d67550fe9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d6a1a6ea-5a7e-427b-8d9b-60d67550fe9f_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252Fd0482dd3-904e-4e6b-972a-6517439226e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d0482dd3-904e-4e6b-972a-6517439226e4_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252Fba024fed-8694-4fa9-812a-1cb3f9d00b19_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ba024fed-8694-4fa9-812a-1cb3f9d00b19_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F5c6cf8dc-73c6-4ac6-823d-f8cc523df5dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/5c6cf8dc-73c6-4ac6-823d-f8cc523df5dd_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F1372dbe4-e028-462f-a81d-3eb6cca87f5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/1372dbe4-e028-462f-a81d-3eb6cca87f5c_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F9479e83f-ffa4-4d6a-be8e-00066cd27efb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/9479e83f-ffa4-4d6a-be8e-00066cd27efb_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBK72GKA%252F2025-11-24%252Fimage%252F8cb5f423-dbef-488e-8445-0254e1dd5b99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cb5f423-dbef-488e-8445-0254e1dd5b99_removebg.jpg?w=600 already downloaded
2025-12-03 19:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e9afa1b7-074b-5bce-bf36-32cd8f4e613e, identifier: 117449793
2025-12-03 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf9290>
2025-12-03 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117697673
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117697673%27 HTTP/1.1" 200 None
2025-12-03 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117697673: 1
2025-12-03 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e9afa1b7-074b-5bce-bf36-32cd8f4e613e with identifier: 117449793
2025-12-03 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e9afa1b7-074b-5bce-bf36-32cd8f4e613e with identifier: 117449793
2025-12-03 19:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e9afa1b7-074b-5bce-bf36-32cd8f4e613e with identifier: 117449793 to the API
2025-12-03 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117449793?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'e9afa1b7-074b-5bce-bf36-32cd8f4e613e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BK72GKA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117449793',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 17565,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photo_urls': ['https://abimg003.imgix.net/BK72GKA/2025-11-24/image/67cafd44-4f32-4636-b182-895e813fe45d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/6e1ff096-e82f-49c6-85dd-9e5da8092fc1_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/cce77126-f282-4f4b-ba8e-c8ddf26b8ecc_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/aef7541f-dc2b-4d31-a987-70db929d40a5_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/234a788b-e4f5-4296-9217-d2ab705e5013_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/390dca3c-60df-4e43-917a-eabe5cfe4f70_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/2107058b-0295-406f-8f1d-0e93697ceca9_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ae3bed8c-c081-4677-9083-19c9763b2dc4_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cf7b139-ff4e-4607-93f9-006415927146_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/475dfdcc-92b5-4ca1-9b5e-c6046266fcdd_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/22fa354b-284d-4bd2-9e8a-f3485c536954_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/0ec228b5-fac6-46f2-b6ee-306f6c7f51d3_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8fdf27bf-7a23-4945-a879-e6fcfd448e34_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d6a1a6ea-5a7e-427b-8d9b-60d67550fe9f_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d0482dd3-904e-4e6b-972a-6517439226e4_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ba024fed-8694-4fa9-812a-1cb3f9d00b19_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/5c6cf8dc-73c6-4ac6-823d-f8cc523df5dd_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/1372dbe4-e028-462f-a81d-3eb6cca87f5c_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/9479e83f-ffa4-4d6a-be8e-00066cd27efb_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cb5f423-dbef-488e-8445-0254e1dd5b99_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33488,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/67cafd44-4f32-4636-b182-895e813fe45d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34488,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/6e1ff096-e82f-49c6-85dd-9e5da8092fc1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34810,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/cce77126-f282-4f4b-ba8e-c8ddf26b8ecc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36185,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/aef7541f-dc2b-4d31-a987-70db929d40a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51078,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/234a788b-e4f5-4296-9217-d2ab705e5013_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53489,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/390dca3c-60df-4e43-917a-eabe5cfe4f70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47991,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/2107058b-0295-406f-8f1d-0e93697ceca9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53409,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ae3bed8c-c081-4677-9083-19c9763b2dc4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45831,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cf7b139-ff4e-4607-93f9-006415927146_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59480,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/475dfdcc-92b5-4ca1-9b5e-c6046266fcdd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51178,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/22fa354b-284d-4bd2-9e8a-f3485c536954_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47747,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/0ec228b5-fac6-46f2-b6ee-306f6c7f51d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44819,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8fdf27bf-7a23-4945-a879-e6fcfd448e34_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42081,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d6a1a6ea-5a7e-427b-8d9b-60d67550fe9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46721,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/d0482dd3-904e-4e6b-972a-6517439226e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25466,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/ba024fed-8694-4fa9-812a-1cb3f9d00b19_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43081,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/5c6cf8dc-73c6-4ac6-823d-f8cc523df5dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48456,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/1372dbe4-e028-462f-a81d-3eb6cca87f5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46461,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/9479e83f-ffa4-4d6a-be8e-00066cd27efb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9afa1b7-074b-5bce-bf36-32cd8f4e613e/e9afa1b7-074b-5bce-bf36-32cd8f4e613e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46450,
             'Height': 797,
             'OriginUrl': 'https://abimg003.imgix.net/BK72GKA/2025-11-24/image/8cb5f423-dbef-488e-8445-0254e1dd5b99_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi SE Connect 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 TGDi SE Connect 5dr 2WD',
 'vin': None,
 'year': 2022}
2025-12-03 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117449793%27 HTTP/1.1" 200 None
2025-12-03 19:02:06 [astonbarclay.gb] INFO: Saving data for 117449793: {'created_time': 1764788526.935696, 'last_price_update_time': 1764788526.935705, 'auction_closing_time': 1765275300.0}
2025-12-03 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117449793') HTTP/1.1" 204 0
2025-12-03 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 57 pages/min), scraped 64 items (at 37 items/min)
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117272128
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272128%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Scrape type for 117272128: 0
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117571999
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571999%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Scrape type for 117571999: 2
2025-12-03 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117677344?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563937, 'registration': 'LM22VGX', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto', 'mileage': 25388, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-06-22', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f961579a-4f59-45d1-999e-76297043140a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5cff0b8e-0345-4f55-b998-d456865ad8f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/e9efcad3-ed17-4e16-9d59-00a7d452954c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/55ca4fde-171a-46ed-9411-5e7079566f91_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23-11k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/09c1997b-ce10-4022-8c16-eeee531947bd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563937, 'registration': 'LM22VGX', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto', 'mileage': 25388, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-06-22', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f961579a-4f59-45d1-999e-76297043140a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5cff0b8e-0345-4f55-b998-d456865ad8f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/e9efcad3-ed17-4e16-9d59-00a7d452954c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/55ca4fde-171a-46ed-9411-5e7079566f91_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23-11k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/09c1997b-ce10-4022-8c16-eeee531947bd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60226794-c2fd-5847-9aa6-71873c5f1f67 with identifier: 117563937
2025-12-03 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60226794-c2fd-5847-9aa6-71873c5f1f67 with scrape type 1
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Fd3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117195495, 'registration': 'YE73WNP', 'account': 'RCI001', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-Tech full hybrid 145 Evolution 5dr Auto', 'mileage': 22104, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 276, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-10-13', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE73WNP/2025-11-24/image/93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/dcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/bcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25-21k, 10/25-22k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c2aec1a2-b2fa-4167-84a1-9266e5a8b57c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117195495, 'registration': 'YE73WNP', 'account': 'RCI001', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-Tech full hybrid 145 Evolution 5dr Auto', 'mileage': 22104, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 276, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-10-13', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE73WNP/2025-11-24/image/93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/dcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/bcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25-21k, 10/25-22k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c2aec1a2-b2fa-4167-84a1-9266e5a8b57c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a97766-adc5-50e1-914e-c1f39eb6b4b7 with identifier: 117195495
2025-12-03 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7 with scrape type 1
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117701765, 'registration': 'LB65XAM', 'account': 'STA058', 'make': 'KIA', 'model': 'CEED SPORTSWAGON SPECIAL EDITIONS', 'derivative': '1.4 SR7 5dr', 'mileage': 72083, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-02-01', 'fuel': 'Petrol', 'motExpiry': '2025-11-20', 'doors': 5, 'engineSize': 1396, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB65XAM/2025-12-03/image/172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/f96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/bf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9cf41a13-3453-4b90-8c90-debc0d073648.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117701765, 'registration': 'LB65XAM', 'account': 'STA058', 'make': 'KIA', 'model': 'CEED SPORTSWAGON SPECIAL EDITIONS', 'derivative': '1.4 SR7 5dr', 'mileage': 72083, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-02-01', 'fuel': 'Petrol', 'motExpiry': '2025-11-20', 'doors': 5, 'engineSize': 1396, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB65XAM/2025-12-03/image/172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/f96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/bf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9cf41a13-3453-4b90-8c90-debc0d073648.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc62219-6172-51aa-a171-ab470020458b with identifier: 117701765
2025-12-03 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc62219-6172-51aa-a171-ab470020458b with scrape type 1
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117702364, 'registration': 'PE16VTA', 'account': 'VAN052', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX4h 5dr Auto', 'mileage': 88876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-29', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg?w=600', 'https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600', 'https://abimg002.imgix.net/2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg?w=600', 'https://abimg002.imgix.net/2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg?w=600', 'https://abimg002.imgix.net/0bff71f4-efcf-4b7d-8013-44952d28f322.jpg?w=600', 'https://abimg002.imgix.net/8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg?w=600', 'https://abimg002.imgix.net/0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg?w=600', 'https://abimg002.imgix.net/cb439393-92ef-4e91-807c-952f3fd837f2.jpg?w=600', 'https://abimg002.imgix.net/34377564-01fd-40f0-8557-fe44763244fd.jpg?w=600', 'https://abimg002.imgix.net/e6eaea09-efa9-404d-ae48-14767852cb70.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '**1376**VOSA STATES 25K, 35K, 43K, 53K, 63K, 74K, 83K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 42, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117702364, 'registration': 'PE16VTA', 'account': 'VAN052', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX4h 5dr Auto', 'mileage': 88876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-29', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg?w=600', 'https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600', 'https://abimg002.imgix.net/2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg?w=600', 'https://abimg002.imgix.net/2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg?w=600', 'https://abimg002.imgix.net/0bff71f4-efcf-4b7d-8013-44952d28f322.jpg?w=600', 'https://abimg002.imgix.net/8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg?w=600', 'https://abimg002.imgix.net/0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg?w=600', 'https://abimg002.imgix.net/cb439393-92ef-4e91-807c-952f3fd837f2.jpg?w=600', 'https://abimg002.imgix.net/34377564-01fd-40f0-8557-fe44763244fd.jpg?w=600', 'https://abimg002.imgix.net/e6eaea09-efa9-404d-ae48-14767852cb70.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '**1376**VOSA STATES 25K, 35K, 43K, 53K, 63K, 74K, 83K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 42, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7faa3e6f-aabb-563b-aec6-b21599755065 with identifier: 117702364
2025-12-03 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faa3e6f-aabb-563b-aec6-b21599755065 with scrape type 1
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117719094, 'registration': 'GX70XSK', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO FR 5dr', 'mileage': 24475, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-03', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/22-13k 10/24-21k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117719094, 'registration': 'GX70XSK', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO FR 5dr', 'mileage': 24475, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-03', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/22-13k 10/24-21k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aa1837c-214d-5f98-883d-3f83c377ede4 with identifier: 117719094
2025-12-03 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa1837c-214d-5f98-883d-3f83c377ede4 with scrape type 1
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3aa1837c-214d-5f98-883d-3f83c377ede4
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3aa1837c-214d-5f98-883d-3f83c377ede4
2025-12-03 19:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3aa1837c-214d-5f98-883d-3f83c377ede4, identifier: 117719094
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117729380, 'registration': 'CJ73HRF', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 21985, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-12-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/25-16k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117729380, 'registration': 'CJ73HRF', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 21985, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-12-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/25-16k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97d16b9-a17f-5684-b02a-a1d4b0cebacb with identifier: 117729380
2025-12-03 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97d16b9-a17f-5684-b02a-a1d4b0cebacb with scrape type 1
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b97d16b9-a17f-5684-b02a-a1d4b0cebacb
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b97d16b9-a17f-5684-b02a-a1d4b0cebacb
2025-12-03 19:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b97d16b9-a17f-5684-b02a-a1d4b0cebacb, identifier: 117729380
2025-12-03 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3aa1837c-214d-5f98-883d-3f83c377ede4 with identifier: 117719094
2025-12-03 19:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3aa1837c-214d-5f98-883d-3f83c377ede4 with identifier: 117719094
2025-12-03 19:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3aa1837c-214d-5f98-883d-3f83c377ede4 with identifier: 117719094 to the API
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273aa1837c-214d-5f98-883d-3f83c377ede4%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3aa1837c-214d-5f98-883d-3f83c377ede4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117719094?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '3aa1837c-214d-5f98-883d-3f83c377ede4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX70XSK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117719094',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 24475,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': 'Motability Operations',
 'title': 'SEAT ATECA ESTATE 1.5 TSI EVO FR 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO FR 5dr',
 'vin': None,
 'year': 2020}
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117719094%27 HTTP/1.1" 200 None
2025-12-03 19:02:07 [astonbarclay.gb] INFO: Saving data for 117719094: {'created_time': 1764788527.771386, 'last_price_update_time': 1764788527.771398, 'auction_closing_time': 1765275300.0}
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117719094') HTTP/1.1" 204 0
2025-12-03 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b97d16b9-a17f-5684-b02a-a1d4b0cebacb with identifier: 117729380
2025-12-03 19:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b97d16b9-a17f-5684-b02a-a1d4b0cebacb with identifier: 117729380
2025-12-03 19:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b97d16b9-a17f-5684-b02a-a1d4b0cebacb with identifier: 117729380 to the API
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b97d16b9-a17f-5684-b02a-a1d4b0cebacb%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b97d16b9-a17f-5684-b02a-a1d4b0cebacb: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117729380?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'b97d16b9-a17f-5684-b02a-a1d4b0cebacb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CJ73HRF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117729380',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'ZS HATCHBACK',
 'odometer': 21985,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-16',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK ZS HATCHBACK 1.0T GDi Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0T GDi Exclusive 5dr DCT',
 'vin': None,
 'year': 2023}
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117729380%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Saving data for 117729380: {'created_time': 1764788528.119194, 'last_price_update_time': 1764788528.119203, 'auction_closing_time': 1765275300.0}
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117729380') HTTP/1.1" 204 0
2025-12-03 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117458552
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458552%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117458552: 2
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Ff46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252Ff90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd5ad0>
2025-12-03 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Fd6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252Fa026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117677344, 'registration': 'DA17SVK', 'account': 'VAN041', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL ESTATE', 'derivative': '2.0 TDI 184 GTD 5dr DSG', 'mileage': 96995, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-07-05', 'fuel': 'Diesel', 'motExpiry': '2026-08-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 04/18 - 8K, 03/19 - 18K, 10/19 - 30K, 11/22 - 70K, 11/23 - 80K, 11/24 - 90K,  07/20 - 41K, 03/20 - 51K,', 'remarks': '**1216** VOSA STATES 41K, 55K, 67K, 77K, 86K, 95K, SD CARD', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ce0d909-8f10-4b69-b4a4-5c57edca56b1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117677344, 'registration': 'DA17SVK', 'account': 'VAN041', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL ESTATE', 'derivative': '2.0 TDI 184 GTD 5dr DSG', 'mileage': 96995, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-07-05', 'fuel': 'Diesel', 'motExpiry': '2026-08-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 04/18 - 8K, 03/19 - 18K, 10/19 - 30K, 11/22 - 70K, 11/23 - 80K, 11/24 - 90K,  07/20 - 41K, 03/20 - 51K,', 'remarks': '**1216** VOSA STATES 41K, 55K, 67K, 77K, 86K, 95K, SD CARD', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ce0d909-8f10-4b69-b4a4-5c57edca56b1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d8617cc-a742-5f8e-b95e-53d30850742e with identifier: 117677344
2025-12-03 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d8617cc-a742-5f8e-b95e-53d30850742e with scrape type 1
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6d8617cc-a742-5f8e-b95e-53d30850742e
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6d8617cc-a742-5f8e-b95e-53d30850742e
2025-12-03 19:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6d8617cc-a742-5f8e-b95e-53d30850742e, identifier: 117677344
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117551156
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551156%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117551156: 2
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252Fdcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/dcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Ff96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/f96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg?w=600 not downloaded yet
2025-12-03 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6d8617cc-a742-5f8e-b95e-53d30850742e with identifier: 117677344
2025-12-03 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6d8617cc-a742-5f8e-b95e-53d30850742e with identifier: 117677344
2025-12-03 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156097 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156097
2025-12-03 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6d8617cc-a742-5f8e-b95e-53d30850742e spider: astonbarclay.gb
2025-12-03 19:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6d8617cc-a742-5f8e-b95e-53d30850742e due to rule: high_mileage_for_country.json, error: 156097 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156097
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6d8617cc-a742-5f8e-b95e-53d30850742e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA17SVK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117677344',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL ESTATE',
 'odometer': 96995,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-05',
 'seller_name': 'Vantage Motor Group',
 'title': 'VOLKSWAGEN GOLF DIESEL ESTATE 2.0 TDI 184 GTD 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 184 GTD 5dr DSG',
 'vin': None,
 'year': 2017}
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117677344%27 HTTP/1.1" 200 None
2025-12-03 19:02:08 [astonbarclay.gb] INFO: Saving data for 117677344: {'created_time': 1764788528.987955, 'last_price_update_time': 1764788528.987967, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117677344') HTTP/1.1" 204 0
2025-12-03 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Fc2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252Fde988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc7910>
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc4790>
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f82a010>
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f852710>
2025-12-03 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb1a590>
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117604369
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604369%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117604369: 0
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117646620
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117646620%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117646620: 1
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252Ffb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/fb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 60238390
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2760238390%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Scrape type for 60238390: 0
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117492135
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492135%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117492135: 2
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Ff961579a-4f59-45d1-999e-76297043140a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f961579a-4f59-45d1-999e-76297043140a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252Fbcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/bcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0bff71f4-efcf-4b7d-8013-44952d28f322.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0bff71f4-efcf-4b7d-8013-44952d28f322.jpg?w=600 not downloaded yet
2025-12-03 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117247051?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119f06f750>
2025-12-03 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Ff2931961-33f3-41eb-b234-39affc60a889_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/f96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/dcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:11 [astonbarclay.gb] INFO: Found listing with ID: 117164114
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2025-12-03 19:02:11 [astonbarclay.gb] INFO: Scrape type for 117164114: 2
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg?w=600 not downloaded yet
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e160910>
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg?w=600 saved to cache
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f844110>
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb35690>
2025-12-03 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec4df10>
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 116807925
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116807925%27 HTTP/1.1" 200 None
2025-12-03 19:02:12 [astonbarclay.gb] INFO: Scrape type for 116807925: 2
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Fbf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/bf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg?w=600 not downloaded yet
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc6ed0>
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117247051, 'registration': 'CX66XWA', 'account': 'STA058', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 94216, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-12', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CX66XWA/2025-11-17/image/ef7377c0-520f-4da2-8fbd-243380e402fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/5202b986-36c8-44b5-8146-6014d2bb6d8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/44075861-70af-471a-858f-a1df31220444_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/c824d2b1-c28e-403e-bc06-63bcd11c4727_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/031f6d83-cf74-480c-9c0c-0c72c71ced9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/7ff06a13-bf11-4252-accb-165ced360da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/dd6a2c01-c40f-4455-a121-c7ef9578ce09_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/fe49c395-76f3-4e22-9d95-db47985223d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/994693db-f3e3-49fd-ac5c-13f687c46084_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1473**VOSA STATES 35K, 44K, 57K, 72K, 78K, 87K, 93K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf31a037-6715-446f-96b1-c4bb028fffef.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117247051, 'registration': 'CX66XWA', 'account': 'STA058', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 94216, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-12', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CX66XWA/2025-11-17/image/ef7377c0-520f-4da2-8fbd-243380e402fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/5202b986-36c8-44b5-8146-6014d2bb6d8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/44075861-70af-471a-858f-a1df31220444_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/c824d2b1-c28e-403e-bc06-63bcd11c4727_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/031f6d83-cf74-480c-9c0c-0c72c71ced9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/7ff06a13-bf11-4252-accb-165ced360da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/dd6a2c01-c40f-4455-a121-c7ef9578ce09_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/fe49c395-76f3-4e22-9d95-db47985223d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX66XWA/2025-11-17/image/994693db-f3e3-49fd-ac5c-13f687c46084_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1473**VOSA STATES 35K, 44K, 57K, 72K, 78K, 87K, 93K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf31a037-6715-446f-96b1-c4bb028fffef.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804419c9-cd7c-54b3-8697-e97caee04647 with identifier: 117247051
2025-12-03 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804419c9-cd7c-54b3-8697-e97caee04647 with scrape type 2
2025-12-03 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 804419c9-cd7c-54b3-8697-e97caee04647 with scrape type 2
2025-12-03 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 804419c9-cd7c-54b3-8697-e97caee04647, identifier: 117247051
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117737913?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 804419c9-cd7c-54b3-8697-e97caee04647 with identifier: 117247051
2025-12-03 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 804419c9-cd7c-54b3-8697-e97caee04647 with identifier: 117247051
2025-12-03 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151625 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151625
2025-12-03 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 804419c9-cd7c-54b3-8697-e97caee04647 spider: astonbarclay.gb
2025-12-03 19:02:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 804419c9-cd7c-54b3-8697-e97caee04647 due to rule: high_mileage_for_country.json, error: 151625 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151625
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '804419c9-cd7c-54b3-8697-e97caee04647',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CX66XWA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117247051',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 94216,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-31',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247051%27 HTTP/1.1" 200 None
2025-12-03 19:02:13 [astonbarclay.gb] INFO: Saving data for 117247051: {'auction_closing_time': 1764936000.0, 'created_time': 1763370058.55654, 'last_price_update_time': 1764788533.322643}
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117247051') HTTP/1.1" 204 0
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff5b2d0>
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg?w=600 saved to cache
2025-12-03 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec4d3d0>
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Ff96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/f96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd6150>
2025-12-03 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252Fdcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/dcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f815710>
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252Fa026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec4e090>
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/bcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0bff71f4-efcf-4b7d-8013-44952d28f322.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f961579a-4f59-45d1-999e-76297043140a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 117366912
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366912%27 HTTP/1.1" 200 None
2025-12-03 19:02:14 [astonbarclay.gb] INFO: Scrape type for 117366912: 2
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Fc200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Fd1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fcb439393-92ef-4e91-807c-952f3fd837f2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cb439393-92ef-4e91-807c-952f3fd837f2.jpg?w=600 not downloaded yet
2025-12-03 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116891404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee06e50>
2025-12-03 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252Fde988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117585284
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585284%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117585284: 2
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Fd60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F34377564-01fd-40f0-8557-fe44763244fd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/34377564-01fd-40f0-8557-fe44763244fd.jpg?w=600 not downloaded yet
2025-12-03 19:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117737945?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117637760?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117444914?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117737913, 'registration': 'NL69CXY', 'account': 'VAN044', 'make': 'MAZDA', 'model': 'MAZDA3 SALOON', 'derivative': '2.0 Skyactiv-X MHEV GT Sport Tech 4dr', 'mileage': 36570, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-27', 'fuel': 'Petrol', 'motExpiry': '2026-09-26', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 04/23 - 20K, 05/24 - 27K, 06/25 - 34K', 'remarks': '**1239**VOSA STATES 17K, 22K, 29K, 35K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117737913, 'registration': 'NL69CXY', 'account': 'VAN044', 'make': 'MAZDA', 'model': 'MAZDA3 SALOON', 'derivative': '2.0 Skyactiv-X MHEV GT Sport Tech 4dr', 'mileage': 36570, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-27', 'fuel': 'Petrol', 'motExpiry': '2026-09-26', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 04/23 - 20K, 05/24 - 27K, 06/25 - 34K', 'remarks': '**1239**VOSA STATES 17K, 22K, 29K, 35K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ecbc28c-6287-5034-bc06-3aef05bab628 with identifier: 117737913
2025-12-03 19:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ecbc28c-6287-5034-bc06-3aef05bab628 with scrape type 1
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8ecbc28c-6287-5034-bc06-3aef05bab628
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8ecbc28c-6287-5034-bc06-3aef05bab628
2025-12-03 19:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8ecbc28c-6287-5034-bc06-3aef05bab628, identifier: 117737913
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117600700
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600700%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117600700: 0
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117600618
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600618%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117600618: 0
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117578188
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578188%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117578188: 0
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117444372
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444372%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117444372: 2
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe6eaea09-efa9-404d-ae48-14767852cb70.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e6eaea09-efa9-404d-ae48-14767852cb70.jpg?w=600 not downloaded yet
2025-12-03 19:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8ecbc28c-6287-5034-bc06-3aef05bab628 with identifier: 117737913
2025-12-03 19:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8ecbc28c-6287-5034-bc06-3aef05bab628 with identifier: 117737913
2025-12-03 19:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8ecbc28c-6287-5034-bc06-3aef05bab628 with identifier: 117737913 to the API
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278ecbc28c-6287-5034-bc06-3aef05bab628%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8ecbc28c-6287-5034-bc06-3aef05bab628: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117737913?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8ecbc28c-6287-5034-bc06-3aef05bab628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL69CXY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117737913',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MAZDA',
 'model': 'MAZDA3 SALOON',
 'odometer': 36570,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seller_name': 'Vantage Motor Group',
 'title': 'MAZDA MAZDA3 SALOON 2.0 Skyactiv-X MHEV GT Sport Tech 4dr',
 'transmission': 'manual',
 'trim': '2.0 Skyactiv-X MHEV GT Sport Tech 4dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737913%27 HTTP/1.1" 200 None
2025-12-03 19:02:15 [astonbarclay.gb] INFO: Saving data for 117737913: {'created_time': 1764788535.918702, 'last_price_update_time': 1764788535.918711, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117737913') HTTP/1.1" 204 0
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d5990>
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252Fbcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/bcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebfe490>
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0bff71f4-efcf-4b7d-8013-44952d28f322.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0bff71f4-efcf-4b7d-8013-44952d28f322.jpg?w=600 saved to cache
2025-12-03 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd70d0>
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecb0c10>
2025-12-03 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75b590>
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Ff961579a-4f59-45d1-999e-76297043140a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f961579a-4f59-45d1-999e-76297043140a_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116891404, 'registration': 'SV19HZD', 'account': 'CON001', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS HATCHBACK', 'derivative': 'B200 AMG Line Premium 5dr Auto', 'mileage': 87202, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SV19HZD/2025-11-07/image/636cb38f-a65a-4a02-a669-70a63fdbf535_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/f7299db0-fb7b-4210-8afa-1b18fa351d25_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/abe7ce3e-5618-48b2-90a0-5a462991e72c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/ec3c07a7-e8ab-4878-9577-3014508c85df_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/75d0d2ef-2221-406e-acd5-f9585f34ef31_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/14573359-8afa-4e9e-bad3-491bbd190fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/8f417b2e-ba04-4839-ba1d-12cb5e206ba4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/df526f46-31d0-4503-a9cb-9233a1e67b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/2df2f514-0112-4c4b-bbb1-db82bb1f35ea_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1647**VOSA STATES 23K, 37K, 58K, 59K, 75K,  FRONT PAGE OF V5 ONLY', 'virtual': False, 'seller': 'Direct Finance Company', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/998c223f-4222-4f76-8a71-4c9e9ff7a8f1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116891404, 'registration': 'SV19HZD', 'account': 'CON001', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS HATCHBACK', 'derivative': 'B200 AMG Line Premium 5dr Auto', 'mileage': 87202, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SV19HZD/2025-11-07/image/636cb38f-a65a-4a02-a669-70a63fdbf535_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/f7299db0-fb7b-4210-8afa-1b18fa351d25_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/abe7ce3e-5618-48b2-90a0-5a462991e72c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/ec3c07a7-e8ab-4878-9577-3014508c85df_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/75d0d2ef-2221-406e-acd5-f9585f34ef31_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/14573359-8afa-4e9e-bad3-491bbd190fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/8f417b2e-ba04-4839-ba1d-12cb5e206ba4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/df526f46-31d0-4503-a9cb-9233a1e67b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HZD/2025-11-07/image/2df2f514-0112-4c4b-bbb1-db82bb1f35ea_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1647**VOSA STATES 23K, 37K, 58K, 59K, 75K,  FRONT PAGE OF V5 ONLY', 'virtual': False, 'seller': 'Direct Finance Company', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/998c223f-4222-4f76-8a71-4c9e9ff7a8f1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672bf138-51a9-5d81-a613-4a84b4c46ff8 with identifier: 116891404
2025-12-03 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672bf138-51a9-5d81-a613-4a84b4c46ff8 with scrape type 2
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 672bf138-51a9-5d81-a613-4a84b4c46ff8 with scrape type 2
2025-12-03 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 672bf138-51a9-5d81-a613-4a84b4c46ff8, identifier: 116891404
2025-12-03 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117733240, 'registration': 'SY68YLV', 'account': 'MOT129', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT DIESEL ESTATE', 'derivative': '3.0 SDV6 HSE Dynamic 5dr Auto', 'mileage': 56125, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-07-02', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SY68YLV/2025-12-03/image/2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/eccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/e0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/19 - 10K, 09/20 - 18K, 09/21 - 25K, 07/24 - 46K', 'remarks': '**1933**VOSA STATES 25K, 30K, 40K, 46K, 53K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 198, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf4619a3-3861-487e-b1b8-b6f9decbc5c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117733240, 'registration': 'SY68YLV', 'account': 'MOT129', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT DIESEL ESTATE', 'derivative': '3.0 SDV6 HSE Dynamic 5dr Auto', 'mileage': 56125, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-07-02', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SY68YLV/2025-12-03/image/2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/eccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/e0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/19 - 10K, 09/20 - 18K, 09/21 - 25K, 07/24 - 46K', 'remarks': '**1933**VOSA STATES 25K, 30K, 40K, 46K, 53K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 198, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf4619a3-3861-487e-b1b8-b6f9decbc5c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e1e069-b0dd-5530-b02e-4f38e0873349 with identifier: 117733240
2025-12-03 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e1e069-b0dd-5530-b02e-4f38e0873349 with scrape type 1
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 672bf138-51a9-5d81-a613-4a84b4c46ff8 with identifier: 116891404
2025-12-03 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 672bf138-51a9-5d81-a613-4a84b4c46ff8 with identifier: 116891404
2025-12-03 19:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 672bf138-51a9-5d81-a613-4a84b4c46ff8 with identifier: 116891404 to the API
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27672bf138-51a9-5d81-a613-4a84b4c46ff8%27 HTTP/1.1" 200 None
2025-12-03 19:02:18 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 672bf138-51a9-5d81-a613-4a84b4c46ff8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116891404?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '672bf138-51a9-5d81-a613-4a84b4c46ff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SV19HZD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116891404',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'B CLASS HATCHBACK',
 'odometer': 87202,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seller_name': 'Direct Finance Company',
 'title': 'MERCEDES-BENZ B CLASS HATCHBACK B200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'B200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891404%27 HTTP/1.1" 200 None
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Saving data for 116891404: {'auction_closing_time': 1764936000.0, 'created_time': 1762283864.964635, 'last_price_update_time': 1764788538.111556}
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116891404') HTTP/1.1" 204 0
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/bf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Found listing with ID: 117700117
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700117%27 HTTP/1.1" 200 None
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Scrape type for 117700117: 1
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f76e390>
2025-12-03 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg?w=600 saved to cache
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117665271, 'registration': 'SV18OPP', 'account': 'VAN040', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.6 THP GT Line 5dr EAT6', 'mileage': 51538, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/f7c4632c-9720-4bda-a739-22d02e89261f.jpg?w=600', 'https://abimg002.imgix.net/7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg?w=600', 'https://abimg002.imgix.net/5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg?w=600', 'https://abimg002.imgix.net/7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg?w=600', 'https://abimg002.imgix.net/801b7b90-5ec3-4a24-a752-40b73612620c.jpg?w=600', 'https://abimg002.imgix.net/90899e93-1422-46f8-9076-3f2d161172fd.jpg?w=600', 'https://abimg002.imgix.net/f2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg?w=600', 'https://abimg002.imgix.net/de89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg?w=600', 'https://abimg002.imgix.net/64b6dd6c-c577-4297-922e-19ecd182adeb.jpg?w=600', 'https://abimg002.imgix.net/642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg?w=600', 'https://abimg002.imgix.net/4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg?w=600', 'https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 18K, 22K, 25K, 27K, 36K, 45K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117665271, 'registration': 'SV18OPP', 'account': 'VAN040', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.6 THP GT Line 5dr EAT6', 'mileage': 51538, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/f7c4632c-9720-4bda-a739-22d02e89261f.jpg?w=600', 'https://abimg002.imgix.net/7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg?w=600', 'https://abimg002.imgix.net/5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg?w=600', 'https://abimg002.imgix.net/7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg?w=600', 'https://abimg002.imgix.net/801b7b90-5ec3-4a24-a752-40b73612620c.jpg?w=600', 'https://abimg002.imgix.net/90899e93-1422-46f8-9076-3f2d161172fd.jpg?w=600', 'https://abimg002.imgix.net/f2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg?w=600', 'https://abimg002.imgix.net/de89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg?w=600', 'https://abimg002.imgix.net/64b6dd6c-c577-4297-922e-19ecd182adeb.jpg?w=600', 'https://abimg002.imgix.net/642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg?w=600', 'https://abimg002.imgix.net/4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg?w=600', 'https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 18K, 22K, 25K, 27K, 36K, 45K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a351001-4d21-5794-b75d-785b55d13336 with identifier: 117665271
2025-12-03 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a351001-4d21-5794-b75d-785b55d13336 with scrape type 1
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff7c4632c-9720-4bda-a739-22d02e89261f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f7c4632c-9720-4bda-a739-22d02e89261f.jpg?w=600 not downloaded yet
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117737945, 'registration': 'EN67EYA', 'account': 'VAN044', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium X 5dr Auto', 'mileage': 93027, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-01-25', 'fuel': 'Diesel', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 09/19 - 17K, 06/21 - 35K, 08/22 - 54K, 11/23 - 71K,', 'remarks': '**1383** VOSA STATES 32K, 44K, 58K, 73K, 83K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117737945, 'registration': 'EN67EYA', 'account': 'VAN044', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium X 5dr Auto', 'mileage': 93027, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-01-25', 'fuel': 'Diesel', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 09/19 - 17K, 06/21 - 35K, 08/22 - 54K, 11/23 - 71K,', 'remarks': '**1383** VOSA STATES 32K, 44K, 58K, 73K, 83K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d43b2f-25ce-5211-994c-644c2c269a41 with identifier: 117737945
2025-12-03 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d43b2f-25ce-5211-994c-644c2c269a41 with scrape type 1
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b5d43b2f-25ce-5211-994c-644c2c269a41
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b5d43b2f-25ce-5211-994c-644c2c269a41
2025-12-03 19:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b5d43b2f-25ce-5211-994c-644c2c269a41, identifier: 117737945
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117637760, 'registration': 'NU18SZD', 'account': 'AVL002', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 SD4 240 HSE 5dr Auto', 'mileage': 78451, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-31', 'fuel': 'Diesel', 'motExpiry': '2025-12-15', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 34K, 47K, 59K, 72K, 78K', 'virtual': False, 'seller': 'Advance Vehicle Leasing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 169, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117637760, 'registration': 'NU18SZD', 'account': 'AVL002', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 SD4 240 HSE 5dr Auto', 'mileage': 78451, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-31', 'fuel': 'Diesel', 'motExpiry': '2025-12-15', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 34K, 47K, 59K, 72K, 78K', 'virtual': False, 'seller': 'Advance Vehicle Leasing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 169, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6182b16b-5d1f-5340-8702-94b2627eaf28 with identifier: 117637760
2025-12-03 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6182b16b-5d1f-5340-8702-94b2627eaf28 with scrape type 1
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6182b16b-5d1f-5340-8702-94b2627eaf28
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6182b16b-5d1f-5340-8702-94b2627eaf28
2025-12-03 19:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6182b16b-5d1f-5340-8702-94b2627eaf28, identifier: 117637760
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117444914, 'registration': 'VX19TUO', 'account': 'SPE034', 'make': 'JAGUAR', 'model': 'E-PACE DIESEL ESTATE', 'derivative': '2.0d R-Dynamic S 5dr Auto', 'mileage': 91498, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-20', 'fuel': 'Diesel', 'motExpiry': '2026-05-19', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VX19TUO/2025-11-24/image/3671d7af-f9f7-40b6-a2ad-faad4acb4d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/b08c6421-fe9c-4831-9750-d780a687d56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/2b1bb30c-5ccb-41be-8347-6d1771a661e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/6df804e8-3a01-4060-9187-a17c9a1fcf38_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/9931fd7d-0064-4b83-8f2a-236076410867_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/c5882f53-c79b-417e-ab67-98df48ab4dd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/07a0fa6e-3fbb-440f-8095-56e8316542d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/1f3b5f98-1eb2-49d1-9f8d-75b20b2bf7a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/89ce3523-2ece-4626-97ac-339aa39b2613_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/a53ae204-ee00-4c0a-b79f-7b62d369ca1b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/22 - 45K PHOTOCOPY ONLY', 'remarks': '**1858**VOSA STATES 51K, 61K, 70K, 87K', 'virtual': False, 'seller': 'SVP Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2f4fc9e2-a3ec-4c62-80e8-56265e5cceb2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117444914, 'registration': 'VX19TUO', 'account': 'SPE034', 'make': 'JAGUAR', 'model': 'E-PACE DIESEL ESTATE', 'derivative': '2.0d R-Dynamic S 5dr Auto', 'mileage': 91498, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-20', 'fuel': 'Diesel', 'motExpiry': '2026-05-19', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VX19TUO/2025-11-24/image/3671d7af-f9f7-40b6-a2ad-faad4acb4d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/b08c6421-fe9c-4831-9750-d780a687d56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/2b1bb30c-5ccb-41be-8347-6d1771a661e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/6df804e8-3a01-4060-9187-a17c9a1fcf38_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/9931fd7d-0064-4b83-8f2a-236076410867_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/c5882f53-c79b-417e-ab67-98df48ab4dd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/07a0fa6e-3fbb-440f-8095-56e8316542d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/1f3b5f98-1eb2-49d1-9f8d-75b20b2bf7a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/89ce3523-2ece-4626-97ac-339aa39b2613_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX19TUO/2025-11-24/image/a53ae204-ee00-4c0a-b79f-7b62d369ca1b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/22 - 45K PHOTOCOPY ONLY', 'remarks': '**1858**VOSA STATES 51K, 61K, 70K, 87K', 'virtual': False, 'seller': 'SVP Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2f4fc9e2-a3ec-4c62-80e8-56265e5cceb2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b609cd-0bc1-59ab-a054-39c9dd01be01 with identifier: 117444914
2025-12-03 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b609cd-0bc1-59ab-a054-39c9dd01be01 with scrape type 2
2025-12-03 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b609cd-0bc1-59ab-a054-39c9dd01be01 with scrape type 2
2025-12-03 19:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 59b609cd-0bc1-59ab-a054-39c9dd01be01, identifier: 117444914
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/cb439393-92ef-4e91-807c-952f3fd837f2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116891417?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b5d43b2f-25ce-5211-994c-644c2c269a41 with identifier: 117737945
2025-12-03 19:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b5d43b2f-25ce-5211-994c-644c2c269a41 with identifier: 117737945
2025-12-03 19:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b5d43b2f-25ce-5211-994c-644c2c269a41 with identifier: 117737945 to the API
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b5d43b2f-25ce-5211-994c-644c2c269a41%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b5d43b2f-25ce-5211-994c-644c2c269a41: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117737945?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b5d43b2f-25ce-5211-994c-644c2c269a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN67EYA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117737945',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 93027,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-25',
 'seller_name': 'Vantage Motor Group',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 TDCi 180 Titanium X 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 Titanium X 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737945%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Saving data for 117737945: {'created_time': 1764788539.117918, 'last_price_update_time': 1764788539.11793, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117737945') HTTP/1.1" 204 0
2025-12-03 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6182b16b-5d1f-5340-8702-94b2627eaf28 with identifier: 117637760
2025-12-03 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6182b16b-5d1f-5340-8702-94b2627eaf28 with identifier: 117637760
2025-12-03 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6182b16b-5d1f-5340-8702-94b2627eaf28 with identifier: 117637760 to the API
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276182b16b-5d1f-5340-8702-94b2627eaf28%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6182b16b-5d1f-5340-8702-94b2627eaf28: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117637760?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6182b16b-5d1f-5340-8702-94b2627eaf28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NU18SZD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117637760',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 78451,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': 'Advance Vehicle Leasing',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 SD4 240 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 SD4 240 HSE 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117637760%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Saving data for 117637760: {'created_time': 1764788539.404281, 'last_price_update_time': 1764788539.40429, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117637760') HTTP/1.1" 204 0
2025-12-03 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 59b609cd-0bc1-59ab-a054-39c9dd01be01 with identifier: 117444914
2025-12-03 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 59b609cd-0bc1-59ab-a054-39c9dd01be01 with identifier: 117444914
2025-12-03 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 59b609cd-0bc1-59ab-a054-39c9dd01be01 with identifier: 117444914 to the API
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117444914?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '59b609cd-0bc1-59ab-a054-39c9dd01be01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VX19TUO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117444914',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'JAGUAR',
 'model': 'E-PACE DIESEL ESTATE',
 'odometer': 91498,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': 'SVP Ltd',
 'title': 'JAGUAR E-PACE DIESEL ESTATE 2.0d R-Dynamic S 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0d R-Dynamic S 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444914%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Saving data for 117444914: {'auction_closing_time': 1764936000.0, 'created_time': 1764010916.834254, 'last_price_update_time': 1764788539.746394}
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117444914') HTTP/1.1" 204 0
2025-12-03 19:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Found listing with ID: 117585035
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585035%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Scrape type for 117585035: 0
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Found listing with ID: 116895357
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116895357%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [astonbarclay.gb] INFO: Scrape type for 116895357: 2
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg?w=600 not downloaded yet
2025-12-03 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec2ebd0>
2025-12-03 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75aed0>
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg?w=600 saved to cache
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/34377564-01fd-40f0-8557-fe44763244fd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec26150>
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cae5c10>
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Fd1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebe0710>
2025-12-03 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f9dbf90>
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebe3f90>
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Fbf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/bf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e6eaea09-efa9-404d-ae48-14767852cb70.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:21 [astonbarclay.gb] INFO: Found listing with ID: 117475684
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475684%27 HTTP/1.1" 200 None
2025-12-03 19:02:21 [astonbarclay.gb] INFO: Scrape type for 117475684: 2
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg?w=600 not downloaded yet
2025-12-03 19:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecebd50>
2025-12-03 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f79c4d0>
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Fc200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca79d0>
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fcb439393-92ef-4e91-807c-952f3fd837f2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cb439393-92ef-4e91-807c-952f3fd837f2.jpg?w=600 saved to cache
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116891417, 'registration': 'KS18HFB', 'account': 'CON001', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 80424, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-06-11', 'fuel': 'Diesel', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KS18HFB/2025-11-07/image/0a3bb993-23bf-495c-a559-4f78e1ca603b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/770b68eb-bebe-4a22-a6a3-394a7ee7ad71_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/63bb8940-4383-45a5-a559-4dc96a670c53_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/9c7e01a1-f46d-48f2-bc19-88fd65e4333c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/b10e4c78-2b74-4a51-9393-0e9c5d898abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/6b623c9e-124e-4c3b-a538-0976bc6aaf47_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/f45c3b91-c29f-49ed-aa6c-b127cd3139dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/b6d30cfe-90e9-48f4-ba7c-8083b56f1136_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/2c4970e0-6a81-41e6-be09-b0e3e87cd4a2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1483**VOSA STATES 48K, 55K, 69K, 79K, 80K,', 'virtual': False, 'seller': 'Direct Finance Company', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/caff40f5-1890-405d-92ea-3c6cf8a93dbe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116891417, 'registration': 'KS18HFB', 'account': 'CON001', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 80424, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-06-11', 'fuel': 'Diesel', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KS18HFB/2025-11-07/image/0a3bb993-23bf-495c-a559-4f78e1ca603b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/770b68eb-bebe-4a22-a6a3-394a7ee7ad71_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/63bb8940-4383-45a5-a559-4dc96a670c53_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/9c7e01a1-f46d-48f2-bc19-88fd65e4333c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/b10e4c78-2b74-4a51-9393-0e9c5d898abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/6b623c9e-124e-4c3b-a538-0976bc6aaf47_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/f45c3b91-c29f-49ed-aa6c-b127cd3139dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/b6d30cfe-90e9-48f4-ba7c-8083b56f1136_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS18HFB/2025-11-07/image/2c4970e0-6a81-41e6-be09-b0e3e87cd4a2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1483**VOSA STATES 48K, 55K, 69K, 79K, 80K,', 'virtual': False, 'seller': 'Direct Finance Company', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/caff40f5-1890-405d-92ea-3c6cf8a93dbe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e5494b-af7e-5eb6-9753-c64b799f7024 with identifier: 116891417
2025-12-03 19:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e5494b-af7e-5eb6-9753-c64b799f7024 with scrape type 2
2025-12-03 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88e5494b-af7e-5eb6-9753-c64b799f7024 with scrape type 2
2025-12-03 19:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 88e5494b-af7e-5eb6-9753-c64b799f7024, identifier: 116891417
2025-12-03 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116807925?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117492135?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 88e5494b-af7e-5eb6-9753-c64b799f7024 with identifier: 116891417
2025-12-03 19:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 88e5494b-af7e-5eb6-9753-c64b799f7024 with identifier: 116891417
2025-12-03 19:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 88e5494b-af7e-5eb6-9753-c64b799f7024 with identifier: 116891417 to the API
2025-12-03 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2788e5494b-af7e-5eb6-9753-c64b799f7024%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 88e5494b-af7e-5eb6-9753-c64b799f7024: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116891417?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '88e5494b-af7e-5eb6-9753-c64b799f7024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KS18HFB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116891417',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '3008 DIESEL ESTATE',
 'odometer': 80424,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': 'Direct Finance Company',
 'title': 'PEUGEOT 3008 DIESEL ESTATE 1.5 BlueHDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891417%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [astonbarclay.gb] INFO: Saving data for 116891417: {'auction_closing_time': 1764936000.0, 'created_time': 1762283888.365026, 'last_price_update_time': 1764788543.167558}
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116891417') HTTP/1.1" 204 0
2025-12-03 19:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f7c4632c-9720-4bda-a739-22d02e89261f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117585190
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585190%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117585190: 0
2025-12-03 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117737879
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737879%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117737879: 1
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Fc5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252Feccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/eccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg?w=600 not downloaded yet
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed59a90>
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F34377564-01fd-40f0-8557-fe44763244fd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/34377564-01fd-40f0-8557-fe44763244fd.jpg?w=600 saved to cache
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb98050>
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252Fd60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f822390>
2025-12-03 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117697673, 'registration': 'YK66MOV', 'account': 'VAN040', 'make': 'BMW', 'model': '2 SERIES ACTIVE TOURER', 'derivative': '225xe Sport 5dr [Nav] Auto', 'mileage': 27937, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-15', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg?w=600', 'https://abimg002.imgix.net/062cc636-845d-4d2e-a731-984fd7197e58.jpg?w=600', 'https://abimg002.imgix.net/247ecae1-083d-4b7e-b033-2dd9117badf3.jpg?w=600', 'https://abimg002.imgix.net/d1be310f-2631-4ff6-8088-e7e260f5db50.jpg?w=600', 'https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600', 'https://abimg002.imgix.net/2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg?w=600', 'https://abimg002.imgix.net/86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service print 10/18 - 14K, 09/19 - 16K, 09/20 - 18K, 09/21 - 18K, 08/22 - 21K, 09/23 - 22K, 09/24 - 25K, 09/25 - 27K,', 'remarks': '**1316**VOSA STATES 16K, 17K, 18K, 20K, 22K, 24K, 27K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 49, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117697673, 'registration': 'YK66MOV', 'account': 'VAN040', 'make': 'BMW', 'model': '2 SERIES ACTIVE TOURER', 'derivative': '225xe Sport 5dr [Nav] Auto', 'mileage': 27937, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-15', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg?w=600', 'https://abimg002.imgix.net/062cc636-845d-4d2e-a731-984fd7197e58.jpg?w=600', 'https://abimg002.imgix.net/247ecae1-083d-4b7e-b033-2dd9117badf3.jpg?w=600', 'https://abimg002.imgix.net/d1be310f-2631-4ff6-8088-e7e260f5db50.jpg?w=600', 'https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600', 'https://abimg002.imgix.net/2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg?w=600', 'https://abimg002.imgix.net/86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service print 10/18 - 14K, 09/19 - 16K, 09/20 - 18K, 09/21 - 18K, 08/22 - 21K, 09/23 - 22K, 09/24 - 25K, 09/25 - 27K,', 'remarks': '**1316**VOSA STATES 16K, 17K, 18K, 20K, 22K, 24K, 27K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 49, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54ef3661-d415-509b-9f68-bae992689b81 with identifier: 117697673
2025-12-03 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54ef3661-d415-509b-9f68-bae992689b81 with scrape type 1
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg?w=600 not downloaded yet
2025-12-03 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec1ff50>
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7b3b10>
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe6eaea09-efa9-404d-ae48-14767852cb70.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e6eaea09-efa9-404d-ae48-14767852cb70.jpg?w=600 saved to cache
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf2750>
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 117688221
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117688221%27 HTTP/1.1" 200 None
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Scrape type for 117688221: 0
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 117600158
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600158%27 HTTP/1.1" 200 None
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Scrape type for 117600158: 0
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 117730170
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117730170%27 HTTP/1.1" 200 None
2025-12-03 19:02:24 [astonbarclay.gb] INFO: Scrape type for 117730170: 1
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F801b7b90-5ec3-4a24-a752-40b73612620c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/801b7b90-5ec3-4a24-a752-40b73612620c.jpg?w=600 not downloaded yet
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F062cc636-845d-4d2e-a731-984fd7197e58.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/062cc636-845d-4d2e-a731-984fd7197e58.jpg?w=600 not downloaded yet
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edbe9d0>
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f847a50>
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee65950>
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116807925, 'registration': 'YB18DYM', 'account': 'STA058', 'make': 'BMW', 'model': '1 SERIES HATCHBACK SPECIAL EDITION', 'derivative': '118i [1.5] M Sport Shadow Ed 5dr Step Auto', 'mileage': 96056, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-29', 'fuel': 'Petrol', 'motExpiry': '2026-05-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB18DYM/2025-10-31/image/74757a27-1c78-47d8-b8e8-c9be2fe52fc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/753c0a13-2c80-43f9-882a-18b8c9ed59cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/c80b62f0-bc93-4d0d-895f-fde6deacb543_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/12006174-a783-473c-9e35-d11513bc7b3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/82133765-a503-4851-a856-c7bc48f6f7a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/c78a4aff-ebff-4d16-aa96-5086d8fd7955_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/a4f1d1a5-8709-4566-8a91-60f1d141ca23_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/6e5e8fd1-2c7f-4799-966d-ebbebe820221_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/93bd1d2b-b1d9-4e3d-a7b7-cc534238918d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/2c388c54-251c-4eb0-a481-98e938d71a6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/e7c972cf-2837-45a9-ac33-389644691412_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 05/19 - 19K, 01/25 - 80K', 'remarks': '**1558** VOSA STATES 34K, 42K, 51K, 64K, 89K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d3cbc344-62c1-4acb-957c-f9d99a0e0808.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116807925, 'registration': 'YB18DYM', 'account': 'STA058', 'make': 'BMW', 'model': '1 SERIES HATCHBACK SPECIAL EDITION', 'derivative': '118i [1.5] M Sport Shadow Ed 5dr Step Auto', 'mileage': 96056, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-29', 'fuel': 'Petrol', 'motExpiry': '2026-05-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB18DYM/2025-10-31/image/74757a27-1c78-47d8-b8e8-c9be2fe52fc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/753c0a13-2c80-43f9-882a-18b8c9ed59cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/c80b62f0-bc93-4d0d-895f-fde6deacb543_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/12006174-a783-473c-9e35-d11513bc7b3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/82133765-a503-4851-a856-c7bc48f6f7a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/c78a4aff-ebff-4d16-aa96-5086d8fd7955_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/a4f1d1a5-8709-4566-8a91-60f1d141ca23_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/6e5e8fd1-2c7f-4799-966d-ebbebe820221_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/93bd1d2b-b1d9-4e3d-a7b7-cc534238918d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/2c388c54-251c-4eb0-a481-98e938d71a6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB18DYM/2025-10-31/image/e7c972cf-2837-45a9-ac33-389644691412_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 05/19 - 19K, 01/25 - 80K', 'remarks': '**1558** VOSA STATES 34K, 42K, 51K, 64K, 89K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d3cbc344-62c1-4acb-957c-f9d99a0e0808.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 with identifier: 116807925
2025-12-03 19:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 with scrape type 2
2025-12-03 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 with scrape type 2
2025-12-03 19:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0, identifier: 116807925
2025-12-03 19:02:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117492135, 'registration': 'LY19OTX', 'account': 'AST058', 'make': 'DACIA', 'model': 'DUSTER ESTATE', 'derivative': '1.3 TCe 150 Prestige 5dr', 'mileage': 71798, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LY19OTX/2025-11-25/image/91bf32c6-43e7-41fc-9521-224513bc07d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/e5d9ee7f-23a4-4d80-8b83-8b146f44237a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/6b60f9b0-19fb-416c-866e-bee76c4d9bfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/89cad6c1-256a-4a51-90bb-c0ff9a403875_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/c8be3f82-c594-4de3-aae4-e73f9e5ee38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/093c9a9b-3297-434a-a776-9856511ccafb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/c60aa1d8-1584-4184-8248-60d9804787b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/38adde65-a418-4ca9-bb11-f7026ffb320e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/992090a9-057d-405b-bfe8-62364aeb06cb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/21 - 23K, 03/22 - 36K, 02/23 - 49K, NO DATE - 67K', 'remarks': '**593**VOSA STATES 36K, 50K, 60K, 67K', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/87ed1c5d-812b-49a6-b5db-6232ed0c34b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117492135, 'registration': 'LY19OTX', 'account': 'AST058', 'make': 'DACIA', 'model': 'DUSTER ESTATE', 'derivative': '1.3 TCe 150 Prestige 5dr', 'mileage': 71798, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LY19OTX/2025-11-25/image/91bf32c6-43e7-41fc-9521-224513bc07d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/e5d9ee7f-23a4-4d80-8b83-8b146f44237a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/6b60f9b0-19fb-416c-866e-bee76c4d9bfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/89cad6c1-256a-4a51-90bb-c0ff9a403875_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/c8be3f82-c594-4de3-aae4-e73f9e5ee38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/093c9a9b-3297-434a-a776-9856511ccafb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/c60aa1d8-1584-4184-8248-60d9804787b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/38adde65-a418-4ca9-bb11-f7026ffb320e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OTX/2025-11-25/image/992090a9-057d-405b-bfe8-62364aeb06cb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/21 - 23K, 03/22 - 36K, 02/23 - 49K, NO DATE - 67K', 'remarks': '**593**VOSA STATES 36K, 50K, 60K, 67K', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/87ed1c5d-812b-49a6-b5db-6232ed0c34b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66fde2b9-ea08-5126-8e2c-fbdeb52ee125 with identifier: 117492135
2025-12-03 19:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66fde2b9-ea08-5126-8e2c-fbdeb52ee125 with scrape type 2
2025-12-03 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66fde2b9-ea08-5126-8e2c-fbdeb52ee125 with scrape type 2
2025-12-03 19:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 66fde2b9-ea08-5126-8e2c-fbdeb52ee125, identifier: 117492135
2025-12-03 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117366912?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 with identifier: 116807925
2025-12-03 19:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 with identifier: 116807925
2025-12-03 19:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154586 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154586
2025-12-03 19:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 spider: astonbarclay.gb
2025-12-03 19:02:26 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0 due to rule: high_mileage_for_country.json, error: 154586 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154586
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '300fd6b4-a7b2-56c1-a3cf-0383d1ee67b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB18DYM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116807925',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK SPECIAL EDITION',
 'odometer': 96056,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-29',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'BMW 1 SERIES HATCHBACK SPECIAL EDITION 118i [1.5] M Sport Shadow Ed '
          '5dr Step Auto',
 'transmission': 'automatic',
 'trim': '118i [1.5] M Sport Shadow Ed 5dr Step Auto',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116807925%27 HTTP/1.1" 200 None
2025-12-03 19:02:26 [astonbarclay.gb] INFO: Saving data for 116807925: {'auction_closing_time': 1764936000.0, 'created_time': 1763578957.498963, 'last_price_update_time': 1764788546.419775}
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116807925') HTTP/1.1" 204 0
2025-12-03 19:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 66fde2b9-ea08-5126-8e2c-fbdeb52ee125 with identifier: 117492135
2025-12-03 19:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 66fde2b9-ea08-5126-8e2c-fbdeb52ee125 with identifier: 117492135
2025-12-03 19:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 66fde2b9-ea08-5126-8e2c-fbdeb52ee125 with identifier: 117492135 to the API
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117492135?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '66fde2b9-ea08-5126-8e2c-fbdeb52ee125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY19OTX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117492135',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'DACIA',
 'model': 'DUSTER ESTATE',
 'odometer': 71798,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': 'LDG',
 'title': 'DACIA DUSTER ESTATE 1.3 TCe 150 Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCe 150 Prestige 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492135%27 HTTP/1.1" 200 None
2025-12-03 19:02:26 [astonbarclay.gb] INFO: Saving data for 117492135: {'auction_closing_time': 1764936000.0, 'created_time': 1764097545.73428, 'last_price_update_time': 1764788546.757167}
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117492135') HTTP/1.1" 204 0
2025-12-03 19:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed59710>
2025-12-03 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff7c4632c-9720-4bda-a739-22d02e89261f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f7c4632c-9720-4bda-a739-22d02e89261f.jpg?w=600 saved to cache
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117600051
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600051%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117600051: 0
2025-12-03 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117702797
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702797%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117702797: 0
2025-12-03 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117641062
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641062%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117641062: 1
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F90899e93-1422-46f8-9076-3f2d161172fd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/90899e93-1422-46f8-9076-3f2d161172fd.jpg?w=600 not downloaded yet
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F247ecae1-083d-4b7e-b033-2dd9117badf3.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/247ecae1-083d-4b7e-b033-2dd9117badf3.jpg?w=600 not downloaded yet
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f87d3d0>
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edbe110>
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/fb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff2ee50>
2025-12-03 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg?w=600 saved to cache
2025-12-03 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8ac090>
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9eb10>
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/eccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Found listing with ID: 117660676
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660676%27 HTTP/1.1" 200 None
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Scrape type for 117660676: 0
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Found listing with ID: 117660985
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660985%27 HTTP/1.1" 200 None
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Scrape type for 117660985: 0
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Found listing with ID: 117679098
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679098%27 HTTP/1.1" 200 None
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Scrape type for 117679098: 0
2025-12-03 19:02:28 [astonbarclay.gb] INFO: Found listing with ID: 117626788
2025-12-03 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117626788%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Scrape type for 117626788: 0
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Found listing with ID: 117659595
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117659595%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Scrape type for 117659595: 0
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Found listing with ID: 117632019
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632019%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Scrape type for 117632019: 1
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252Fe0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/e0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg?w=600 not downloaded yet
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd1be310f-2631-4ff6-8088-e7e260f5db50.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d1be310f-2631-4ff6-8088-e7e260f5db50.jpg?w=600 not downloaded yet
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee10190>
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Ff2931961-33f3-41eb-b234-39affc60a889_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8077d0>
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117366912, 'registration': 'FN17ZTM', 'account': 'DJC003', 'make': 'HYUNDAI', 'model': 'IONIQ HATCHBACK', 'derivative': '1.6 GDi Plug-in Hybrid Premium SE 5dr DCT', 'mileage': 95467, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-08-20', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-19', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/a11ac748-a0b2-4ca6-b976-cb448ab3abd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/c45fe88d-dbd5-4084-a862-a20a8e39d5cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/ac063884-9fdc-4b42-b644-604ee2b42660_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/35ba0c49-a1d5-4ccc-853c-97dbff10e3b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/19f86b1f-02c9-4331-a042-81b5e09aa86e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/0ab7484f-5325-419e-ac99-aedb76aff752_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/3525884f-9ebc-415d-a0a6-ec8fe5dcf8e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/0ae80985-bff1-4498-b845-4ad5f66f8929_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/e51f41f7-4603-45c4-a27f-3bcb489a9033_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/17 - 9K, 07/18 - 20K, 04/19 - 31K, 10/19 - 38K, 09/20 - 46K, 09/21 - 53K, 08/22 - 61K, 08/23 - 70K, 08/24 - 81K, 08/25 - 93K', 'remarks': '**1561**VOSA STATES 45K, 52K, 61K, 70K, 81K, 92K,  CHARGING CABLE', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 26, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/06f233ef-56ef-4399-b1a1-9ef68da6ae7d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117366912, 'registration': 'FN17ZTM', 'account': 'DJC003', 'make': 'HYUNDAI', 'model': 'IONIQ HATCHBACK', 'derivative': '1.6 GDi Plug-in Hybrid Premium SE 5dr DCT', 'mileage': 95467, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-08-20', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-19', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/a11ac748-a0b2-4ca6-b976-cb448ab3abd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/c45fe88d-dbd5-4084-a862-a20a8e39d5cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/ac063884-9fdc-4b42-b644-604ee2b42660_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/35ba0c49-a1d5-4ccc-853c-97dbff10e3b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/19f86b1f-02c9-4331-a042-81b5e09aa86e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/0ab7484f-5325-419e-ac99-aedb76aff752_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/3525884f-9ebc-415d-a0a6-ec8fe5dcf8e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/0ae80985-bff1-4498-b845-4ad5f66f8929_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN17ZTM/2025-11-25/image/e51f41f7-4603-45c4-a27f-3bcb489a9033_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/17 - 9K, 07/18 - 20K, 04/19 - 31K, 10/19 - 38K, 09/20 - 46K, 09/21 - 53K, 08/22 - 61K, 08/23 - 70K, 08/24 - 81K, 08/25 - 93K', 'remarks': '**1561**VOSA STATES 45K, 52K, 61K, 70K, 81K, 92K,  CHARGING CABLE', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 26, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/06f233ef-56ef-4399-b1a1-9ef68da6ae7d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec151e87-9e1e-5c80-a367-c512f0ad1afe with identifier: 117366912
2025-12-03 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec151e87-9e1e-5c80-a367-c512f0ad1afe with scrape type 2
2025-12-03 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec151e87-9e1e-5c80-a367-c512f0ad1afe with scrape type 2
2025-12-03 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec151e87-9e1e-5c80-a367-c512f0ad1afe, identifier: 117366912
2025-12-03 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec151e87-9e1e-5c80-a367-c512f0ad1afe with identifier: 117366912
2025-12-03 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec151e87-9e1e-5c80-a367-c512f0ad1afe with identifier: 117366912
2025-12-03 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153638 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153638
2025-12-03 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec151e87-9e1e-5c80-a367-c512f0ad1afe spider: astonbarclay.gb
2025-12-03 19:02:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec151e87-9e1e-5c80-a367-c512f0ad1afe due to rule: high_mileage_for_country.json, error: 153638 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153638
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'ec151e87-9e1e-5c80-a367-c512f0ad1afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FN17ZTM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117366912',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'IONIQ HATCHBACK',
 'odometer': 95467,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-20',
 'seller_name': 'Cox Motor Group',
 'title': 'HYUNDAI IONIQ HATCHBACK 1.6 GDi Plug-in Hybrid Premium SE 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi Plug-in Hybrid Premium SE 5dr DCT',
 'vin': None,
 'year': 2017}
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366912%27 HTTP/1.1" 200 None
2025-12-03 19:02:30 [astonbarclay.gb] INFO: Saving data for 117366912: {'auction_closing_time': 1764936000.0, 'created_time': 1763578947.209799, 'last_price_update_time': 1764788550.030761}
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366912') HTTP/1.1" 204 0
2025-12-03 19:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebffd50>
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg?w=600 saved to cache
2025-12-03 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf0490>
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee13b90>
2025-12-03 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/801b7b90-5ec3-4a24-a752-40b73612620c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:31 [astonbarclay.gb] INFO: Found listing with ID: 117635166
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635166%27 HTTP/1.1" 200 None
2025-12-03 19:02:31 [astonbarclay.gb] INFO: Scrape type for 117635166: 1
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252Ffd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fde89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/de89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg?w=600 not downloaded yet
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600 not downloaded yet
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117164114?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585284?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116895357?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f76ae50>
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252Ffb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/fb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117700117, 'registration': 'ML18UVA', 'account': 'VAN041', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 66909, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML18UVA/2025-12-03/image/52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/a92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/c6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22 - 28K, 07/23 - 40K, 06/24 - 50K, 06/25 - 61K,', 'remarks': '**1369**VOSA STATES 16K, 28K, 41K, 52K, 63K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e5c3c69-fa16-49de-9606-d7e81f5310f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117700117, 'registration': 'ML18UVA', 'account': 'VAN041', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 66909, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML18UVA/2025-12-03/image/52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/a92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/c6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22 - 28K, 07/23 - 40K, 06/24 - 50K, 06/25 - 61K,', 'remarks': '**1369**VOSA STATES 16K, 28K, 41K, 52K, 63K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e5c3c69-fa16-49de-9606-d7e81f5310f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f51bdba-b430-55c5-b60e-f9e201e6b17d with identifier: 117700117
2025-12-03 19:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d with scrape type 1
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/062cc636-845d-4d2e-a731-984fd7197e58.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117475684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f804d10>
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252Feccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/eccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f793410>
2025-12-03 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg?w=600 saved to cache
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 117667252
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117667252%27 HTTP/1.1" 200 None
2025-12-03 19:02:32 [astonbarclay.gb] INFO: Scrape type for 117667252: 0
2025-12-03 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 117703363
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117703363%27 HTTP/1.1" 200 None
2025-12-03 19:02:32 [astonbarclay.gb] INFO: Scrape type for 117703363: 1
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F64b6dd6c-c577-4297-922e-19ecd182adeb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/64b6dd6c-c577-4297-922e-19ecd182adeb.jpg?w=600 not downloaded yet
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg?w=600 not downloaded yet
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee768d0>
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_13.jpg HTTP/1.1" 201 0
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Fc5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119c14ef10>
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg?w=600 saved to cache
2025-12-03 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/247ecae1-083d-4b7e-b033-2dd9117badf3.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/90899e93-1422-46f8-9076-3f2d161172fd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee150d0>
2025-12-03 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F801b7b90-5ec3-4a24-a752-40b73612620c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/801b7b90-5ec3-4a24-a752-40b73612620c.jpg?w=600 saved to cache
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb87d50>
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee16ad0>
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_14.jpg HTTP/1.1" 201 0
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117164114, 'registration': 'LL69NVE', 'account': 'MOT075', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Tekna 5dr', 'mileage': 82306, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2025-10-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL69NVE/2025-11-12/image/77f54dfd-3ac4-4eb4-981f-87a75ecfe30f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9e8fbe2e-88d5-4722-8ae0-75898dcb8118_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9ca7e8c7-0d3f-416c-80df-38d67e44bde9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/1b5a80ed-7ed4-411e-a8c0-70b7d4d85a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/5d0fc242-d398-47a8-af87-ed920291bf22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/24546ee5-0f80-47bf-91e1-3ca6cbc2b868_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/da10857b-4789-4ece-8a8b-81f90525d16a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/bdb32c0b-dcf9-47ab-a4d5-56b924d32447_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/7e8d004f-c058-47ce-8e0a-25a9e5f01e04_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1759**VOSA STATES 53K, 63K, 72K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0d3033c-d08a-4b90-9a8d-7e6229a3fcbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117164114, 'registration': 'LL69NVE', 'account': 'MOT075', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Tekna 5dr', 'mileage': 82306, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2025-10-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL69NVE/2025-11-12/image/77f54dfd-3ac4-4eb4-981f-87a75ecfe30f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9e8fbe2e-88d5-4722-8ae0-75898dcb8118_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/9ca7e8c7-0d3f-416c-80df-38d67e44bde9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/1b5a80ed-7ed4-411e-a8c0-70b7d4d85a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/5d0fc242-d398-47a8-af87-ed920291bf22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/24546ee5-0f80-47bf-91e1-3ca6cbc2b868_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/da10857b-4789-4ece-8a8b-81f90525d16a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/bdb32c0b-dcf9-47ab-a4d5-56b924d32447_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL69NVE/2025-11-12/image/7e8d004f-c058-47ce-8e0a-25a9e5f01e04_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1759**VOSA STATES 53K, 63K, 72K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0d3033c-d08a-4b90-9a8d-7e6229a3fcbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114
2025-12-03 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11278895-e52e-5745-88a0-5f3c8b3f6b0b with scrape type 2
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11278895-e52e-5745-88a0-5f3c8b3f6b0b with scrape type 2
2025-12-03 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 11278895-e52e-5745-88a0-5f3c8b3f6b0b, identifier: 117164114
2025-12-03 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117585284, 'registration': 'NY68VHB', 'account': 'DJC008', 'make': 'MITSUBISHI', 'model': 'ECLIPSE CROSS HATCHBACK', 'derivative': '1.5 4 5dr CVT 4WD', 'mileage': 165837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NY68VHB/2025-12-02/image/d22c18fb-3c6f-42ac-bf45-9b12bbd81770_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/a7dcb44a-9bba-484c-b97c-685febfb8561_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/fd768755-f3ba-40f3-bf50-187535f6e39f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/410e1877-9842-415c-bfbf-a4a177f8a16f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/ff8a063a-920d-47ce-a3ef-1276095327bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/7ee63735-c2e2-4545-98fc-8ae48dc2cc11_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/5e315730-8803-4645-bd1a-d95ee9e44b67_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 08/23 - 65K, 01/24 - 76K', 'remarks': '**1474** VOSA STATES 33K, 49K, 76K, 123K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 175, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b74e7e2e-c76a-4587-b8ed-4b5100ebe27f.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117585284, 'registration': 'NY68VHB', 'account': 'DJC008', 'make': 'MITSUBISHI', 'model': 'ECLIPSE CROSS HATCHBACK', 'derivative': '1.5 4 5dr CVT 4WD', 'mileage': 165837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NY68VHB/2025-12-02/image/d22c18fb-3c6f-42ac-bf45-9b12bbd81770_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/a7dcb44a-9bba-484c-b97c-685febfb8561_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/fd768755-f3ba-40f3-bf50-187535f6e39f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/410e1877-9842-415c-bfbf-a4a177f8a16f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/ff8a063a-920d-47ce-a3ef-1276095327bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/7ee63735-c2e2-4545-98fc-8ae48dc2cc11_removebg.jpg?w=600', 'https://abimg003.imgix.net/NY68VHB/2025-12-02/image/5e315730-8803-4645-bd1a-d95ee9e44b67_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 08/23 - 65K, 01/24 - 76K', 'remarks': '**1474** VOSA STATES 33K, 49K, 76K, 123K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 175, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b74e7e2e-c76a-4587-b8ed-4b5100ebe27f.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with identifier: 117585284
2025-12-03 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with scrape type 2
2025-12-03 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with scrape type 2
2025-12-03 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e, identifier: 117585284
2025-12-03 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116895357, 'registration': 'SV68FYG', 'account': '442001', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Limited 5dr', 'mileage': 51347, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-05-02', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SV68FYG/2025-11-04/image/559d2ba6-c490-4b97-9740-a9c890d33050_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/25434e4b-44e8-4491-848a-45c8847ee515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/1818ab16-d261-424a-a9c2-39ef0e0c5268_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/4188db35-8064-4fc2-a662-71392facc85b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/2aeeaffa-6826-4c22-bbe9-06fa2896fc1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/230cd872-4b12-4237-8ba0-333467e98fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/2c198984-705d-496e-b281-afd00418acba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/18ed6f11-90b3-4232-839a-84ef58550321_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/786f3ac7-e6ff-4784-88b2-85dd1aa8fb16_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/19- 8K, 08/20- 14K, 09/21- 21K, 05/23- 31K, 05/24- 40K, 04/25- 48K,', 'remarks': '**1711**VOSA STATES 21K, 25K, 31K, 40K, 48K, ,  SPARE KEY', 'virtual': False, 'seller': 'Part of United Rental Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff88a436-9e3e-4403-a5f1-402aa5549cee.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116895357, 'registration': 'SV68FYG', 'account': '442001', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Limited 5dr', 'mileage': 51347, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-05-02', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SV68FYG/2025-11-04/image/559d2ba6-c490-4b97-9740-a9c890d33050_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/25434e4b-44e8-4491-848a-45c8847ee515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/1818ab16-d261-424a-a9c2-39ef0e0c5268_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/4188db35-8064-4fc2-a662-71392facc85b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/2aeeaffa-6826-4c22-bbe9-06fa2896fc1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/230cd872-4b12-4237-8ba0-333467e98fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/2c198984-705d-496e-b281-afd00418acba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/18ed6f11-90b3-4232-839a-84ef58550321_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV68FYG/2025-11-04/image/786f3ac7-e6ff-4784-88b2-85dd1aa8fb16_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/19- 8K, 08/20- 14K, 09/21- 21K, 05/23- 31K, 05/24- 40K, 04/25- 48K,', 'remarks': '**1711**VOSA STATES 21K, 25K, 31K, 40K, 48K, ,  SPARE KEY', 'virtual': False, 'seller': 'Part of United Rental Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff88a436-9e3e-4403-a5f1-402aa5549cee.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a3deac-c8b3-50af-9126-440bee23b09a with identifier: 116895357
2025-12-03 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a3deac-c8b3-50af-9126-440bee23b09a with scrape type 2
2025-12-03 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a3deac-c8b3-50af-9126-440bee23b09a with scrape type 2
2025-12-03 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e5a3deac-c8b3-50af-9126-440bee23b09a, identifier: 116895357
2025-12-03 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/e0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:34 [astonbarclay.gb] INFO: Found listing with ID: 117686371
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686371%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [astonbarclay.gb] INFO: Scrape type for 117686371: 1
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg?w=600 not downloaded yet
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg?w=600 not downloaded yet
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252Fa92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/a92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114
2025-12-03 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114
2025-12-03 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 11278895-e52e-5745-88a0-5f3c8b3f6b0b with identifier: 117164114 to the API
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117164114?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '11278895-e52e-5745-88a0-5f3c8b3f6b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL69NVE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117164114',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 82306,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': 'MotoNovo Finance',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Tekna 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [astonbarclay.gb] INFO: Saving data for 117164114: {'auction_closing_time': 1764936000.0, 'created_time': 1762974166.411388, 'last_price_update_time': 1764788554.639301}
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117164114') HTTP/1.1" 204 0
2025-12-03 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with identifier: 117585284
2025-12-03 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with identifier: 117585284
2025-12-03 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'cox motor group', 'price_includes_vat': False, 'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd', 'price': 0, 'currency': 'gbp', 'make': 'mitsubishi', 'model': 'eclipse cross hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol', 'odometer': 165837, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.5 4 5dr cvt 4wd', 'license_plate': 'ny68vhb', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 175, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'mitsubishi eclipse cross hatchback', 'sanitized_make': 'mitsubishi', 'odometer_in_km': 266888}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 175,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ny68vhb',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mitsubishi',
     'make_model': 'mitsubishi eclipse cross hatchback',
     'model': 'eclipse cross hatchback',
     'odometer': 165837,
     'odometer_in_km': 266888,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'mitsubishi',
     'seller_name': 'cox motor group',
     'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd',
     'transmission': 'automatic',
     'trim': '1.5 4 5dr cvt 4wd',
     'vin': None,
     'year': 2019}
2025-12-03 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e spider: astonbarclay.gb
2025-12-03 19:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'cox motor group', 'price_includes_vat': False, 'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd', 'price': 0, 'currency': 'gbp', 'make': 'mitsubishi', 'model': 'eclipse cross hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol', 'odometer': 165837, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.5 4 5dr cvt 4wd', 'license_plate': 'ny68vhb', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 175, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'mitsubishi eclipse cross hatchback', 'sanitized_make': 'mitsubishi', 'odometer_in_km': 266888}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 175,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ny68vhb',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mitsubishi',
     'make_model': 'mitsubishi eclipse cross hatchback',
     'model': 'eclipse cross hatchback',
     'odometer': 165837,
     'odometer_in_km': 266888,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'mitsubishi',
     'seller_name': 'cox motor group',
     'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd',
     'transmission': 'automatic',
     'trim': '1.5 4 5dr cvt 4wd',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NY68VHB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MITSUBISHI',
 'model': 'ECLIPSE CROSS HATCHBACK',
 'odometer': 165837,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'Cox Motor Group',
 'title': 'MITSUBISHI ECLIPSE CROSS HATCHBACK 1.5 4 5dr CVT 4WD',
 'transmission': 'automatic',
 'trim': '1.5 4 5dr CVT 4WD',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585284%27 HTTP/1.1" 200 None
2025-12-03 19:02:34 [astonbarclay.gb] INFO: Saving data for 117585284: {'auction_closing_time': 1764936000.0, 'created_time': 1764615630.876802, 'last_price_update_time': 1764788554.870399}
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585284') HTTP/1.1" 204 0
2025-12-03 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e5a3deac-c8b3-50af-9126-440bee23b09a with identifier: 116895357
2025-12-03 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e5a3deac-c8b3-50af-9126-440bee23b09a with identifier: 116895357
2025-12-03 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e5a3deac-c8b3-50af-9126-440bee23b09a with identifier: 116895357 to the API
2025-12-03 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116895357?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e5a3deac-c8b3-50af-9126-440bee23b09a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SV68FYG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116895357',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK',
 'odometer': 51347,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-29',
 'seller_name': 'Part of United Rental Group',
 'title': 'JEEP RENEGADE HATCHBACK 1.0 T3 GSE Limited 5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Limited 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116895357%27 HTTP/1.1" 200 None
2025-12-03 19:02:35 [astonbarclay.gb] INFO: Saving data for 116895357: {'auction_closing_time': 1764936000.0, 'created_time': 1762283927.95669, 'last_price_update_time': 1764788555.202542}
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116895357') HTTP/1.1" 204 0
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed56510>
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F062cc636-845d-4d2e-a731-984fd7197e58.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/062cc636-845d-4d2e-a731-984fd7197e58.jpg?w=600 saved to cache
2025-12-03 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117475684, 'registration': 'RK16FGZ', 'account': 'MOT075', 'make': 'BMW', 'model': '4 SERIES GRAN DIESEL COUPE', 'derivative': '430d M Sport 5dr Auto [Professional Media]', 'mileage': 150524, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-04-24', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/6a3e176a-4b8d-4a0f-b28d-f1a674d13586_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/cc02d037-d4e0-4eea-aeb8-825d7ba5451a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/b2ce4d55-cbce-4b11-acac-3b04de712c0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/42c5e9f9-7600-4693-86d0-cb93108aece5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/65dbb7f3-f0fd-45c6-8a5a-90c1fc20ccda_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/4d0a7460-9860-4ac0-ae83-30a1170c2c85_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/76609082-f0d4-4d77-a5e6-43ce69e46482_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/ffc9f68c-7398-48e7-ab81-57b251e3e31b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/2ce5c974-9e41-4d08-9afd-1dd6012f532b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1764**VOSA STATES 52K, 71K, 79K, 89K, 99K, 105K, 134K OUTSTANDING RECALL', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10657732-1d79-49f6-bbf0-ef37537a6d33.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117475684, 'registration': 'RK16FGZ', 'account': 'MOT075', 'make': 'BMW', 'model': '4 SERIES GRAN DIESEL COUPE', 'derivative': '430d M Sport 5dr Auto [Professional Media]', 'mileage': 150524, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-04-24', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/6a3e176a-4b8d-4a0f-b28d-f1a674d13586_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/cc02d037-d4e0-4eea-aeb8-825d7ba5451a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/b2ce4d55-cbce-4b11-acac-3b04de712c0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/42c5e9f9-7600-4693-86d0-cb93108aece5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/65dbb7f3-f0fd-45c6-8a5a-90c1fc20ccda_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/4d0a7460-9860-4ac0-ae83-30a1170c2c85_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/76609082-f0d4-4d77-a5e6-43ce69e46482_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/ffc9f68c-7398-48e7-ab81-57b251e3e31b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK16FGZ/2025-11-25/image/2ce5c974-9e41-4d08-9afd-1dd6012f532b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1764**VOSA STATES 52K, 71K, 79K, 89K, 99K, 105K, 134K OUTSTANDING RECALL', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10657732-1d79-49f6-bbf0-ef37537a6d33.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc56899-b31e-52aa-9804-4c33e0c6c220 with identifier: 117475684
2025-12-03 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc56899-b31e-52aa-9804-4c33e0c6c220 with scrape type 2
2025-12-03 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc56899-b31e-52aa-9804-4c33e0c6c220 with scrape type 2
2025-12-03 19:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7bc56899-b31e-52aa-9804-4c33e0c6c220, identifier: 117475684
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d1be310f-2631-4ff6-8088-e7e260f5db50.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117737879?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117730170?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117444372?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7bc56899-b31e-52aa-9804-4c33e0c6c220 with identifier: 117475684
2025-12-03 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7bc56899-b31e-52aa-9804-4c33e0c6c220 with identifier: 117475684
2025-12-03 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'bmw 4 series gran diesel coupe 430d m sport 5dr auto [professional media]', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '4 series gran diesel coupe', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 150524, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117475684', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '430d m sport 5dr auto [professional media]', 'license_plate': 'rk16fgz', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 139, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7bc56899-b31e-52aa-9804-4c33e0c6c220', 'current_year_diff': 9, 'age_in_months': 117, 'make_model': 'bmw 4 series gran diesel coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 242244}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 117,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7bc56899-b31e-52aa-9804-4c33e0c6c220',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'rk16fgz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117475684',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'bmw',
     'make_model': 'bmw 4 series gran diesel coupe',
     'model': '4 series gran diesel coupe',
     'odometer': 150524,
     'odometer_in_km': 242244,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-03-01',
     'sanitized_make': 'bmw',
     'seller_name': 'motonovo finance',
     'title': 'bmw 4 series gran diesel coupe 430d m sport 5dr auto '
              '[professional media]',
     'transmission': 'automatic',
     'trim': '430d m sport 5dr auto [professional media]',
     'vin': None,
     'year': 2016}
2025-12-03 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 7bc56899-b31e-52aa-9804-4c33e0c6c220 spider: astonbarclay.gb
2025-12-03 19:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7bc56899-b31e-52aa-9804-4c33e0c6c220 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'bmw 4 series gran diesel coupe 430d m sport 5dr auto [professional media]', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '4 series gran diesel coupe', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 150524, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117475684', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '430d m sport 5dr auto [professional media]', 'license_plate': 'rk16fgz', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 139, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7bc56899-b31e-52aa-9804-4c33e0c6c220', 'current_year_diff': 9, 'age_in_months': 117, 'make_model': 'bmw 4 series gran diesel coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 242244}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 117,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7bc56899-b31e-52aa-9804-4c33e0c6c220',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'rk16fgz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117475684',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'bmw',
     'make_model': 'bmw 4 series gran diesel coupe',
     'model': '4 series gran diesel coupe',
     'odometer': 150524,
     'odometer_in_km': 242244,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-03-01',
     'sanitized_make': 'bmw',
     'seller_name': 'motonovo finance',
     'title': 'bmw 4 series gran diesel coupe 430d m sport 5dr auto '
              '[professional media]',
     'transmission': 'automatic',
     'trim': '430d m sport 5dr auto [professional media]',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7bc56899-b31e-52aa-9804-4c33e0c6c220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RK16FGZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117475684',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '4 SERIES GRAN DIESEL COUPE',
 'odometer': 150524,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': 'MotoNovo Finance',
 'title': 'BMW 4 SERIES GRAN DIESEL COUPE 430d M Sport 5dr Auto [Professional '
          'Media]',
 'transmission': 'automatic',
 'trim': '430d M Sport 5dr Auto [Professional Media]',
 'vin': None,
 'year': 2016}
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475684%27 HTTP/1.1" 200 None
2025-12-03 19:02:35 [astonbarclay.gb] INFO: Saving data for 117475684: {'auction_closing_time': 1764936000.0, 'created_time': 1764097553.216115, 'last_price_update_time': 1764788555.803241}
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117475684') HTTP/1.1" 204 0
2025-12-03 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9e1010>
2025-12-03 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252F4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 117686613
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686613%27 HTTP/1.1" 200 None
2025-12-03 19:02:36 [astonbarclay.gb] INFO: Scrape type for 117686613: 1
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg?w=600 not downloaded yet
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252Fc6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/c6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb1210>
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_15.jpg HTTP/1.1" 201 0
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1ae50>
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F247ecae1-083d-4b7e-b033-2dd9117badf3.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/247ecae1-083d-4b7e-b033-2dd9117badf3.jpg?w=600 saved to cache
2025-12-03 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb40750>
2025-12-03 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F90899e93-1422-46f8-9076-3f2d161172fd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/90899e93-1422-46f8-9076-3f2d161172fd.jpg?w=600 saved to cache
2025-12-03 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733240?view=catalogue)
2025-12-03 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/de89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eda5110>
2025-12-03 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252Fe0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/e0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee64590>
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg?w=600 saved to cache
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:41 [astonbarclay.gb] INFO: Found listing with ID: 117660491
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660491%27 HTTP/1.1" 200 None
2025-12-03 19:02:41 [astonbarclay.gb] INFO: Scrape type for 117660491: 1
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F15588c82-4d36-469a-b2d1-0f75aa97840e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600 not downloaded yet
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed65b90>
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg?w=600 saved to cache
2025-12-03 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecbf990>
2025-12-03 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecbe510>
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_16.jpg HTTP/1.1" 201 0
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb42e90>
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd1be310f-2631-4ff6-8088-e7e260f5db50.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d1be310f-2631-4ff6-8088-e7e260f5db50.jpg?w=600 saved to cache
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117737879, 'registration': 'UIL5206', 'account': 'VAN044', 'make': 'FORD', 'model': 'KUGA ST-LINE EDITION', 'derivative': None, 'mileage': 9942, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': None, 'firstRegistration': '2022-02-01', 'fuel': 'Hybrid Electric', 'motExpiry': '2025-12-30', 'doors': None, 'engineSize': 2488, 'bodyType': 'MPV', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 06/24 - 3K', 'remarks': '**1352**VOSA STATES 3K, 6K  CHARGING CABLE. Import Manufactured 2020, Model as seen, Cap figures guide only', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': True, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117737879, 'registration': 'UIL5206', 'account': 'VAN044', 'make': 'FORD', 'model': 'KUGA ST-LINE EDITION', 'derivative': None, 'mileage': 9942, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': None, 'firstRegistration': '2022-02-01', 'fuel': 'Hybrid Electric', 'motExpiry': '2025-12-30', 'doors': None, 'engineSize': 2488, 'bodyType': 'MPV', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 06/24 - 3K', 'remarks': '**1352**VOSA STATES 3K, 6K  CHARGING CABLE. Import Manufactured 2020, Model as seen, Cap figures guide only', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': True, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:42 [astonbarclay.gb] ERROR: Error parsing details: Field transmission is not nullable
2025-12-03 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117730170, 'registration': 'BG69KXA', 'account': 'MER023', 'make': 'KIA', 'model': 'OPTIMA DIESEL SPORTSWAGON', 'derivative': '1.6 CRDi ISG 2 5dr', 'mileage': 84369, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-08', 'fuel': 'Diesel', 'motExpiry': '2026-12-12', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 12/20 20K 06/22 45K 10/22 51K 07/23 62K', 'remarks': 'Ex-Private Hire / SKEY, SD CARD', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04fa0d21-d9c0-4f43-b8e3-38b72445cdf2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117730170, 'registration': 'BG69KXA', 'account': 'MER023', 'make': 'KIA', 'model': 'OPTIMA DIESEL SPORTSWAGON', 'derivative': '1.6 CRDi ISG 2 5dr', 'mileage': 84369, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 111}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-08', 'fuel': 'Diesel', 'motExpiry': '2026-12-12', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 12/20 20K 06/22 45K 10/22 51K 07/23 62K', 'remarks': 'Ex-Private Hire / SKEY, SD CARD', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04fa0d21-d9c0-4f43-b8e3-38b72445cdf2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3cc96e3-1926-5b51-bfea-ef9da46a57a6 with identifier: 117730170
2025-12-03 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3cc96e3-1926-5b51-bfea-ef9da46a57a6 with scrape type 1
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c3cc96e3-1926-5b51-bfea-ef9da46a57a6
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c3cc96e3-1926-5b51-bfea-ef9da46a57a6
2025-12-03 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c3cc96e3-1926-5b51-bfea-ef9da46a57a6, identifier: 117730170
2025-12-03 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117444372, 'registration': 'NL68UEV', 'account': '442001', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 83632, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-09-26', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL68UEV/2025-11-24/image/1e233e8b-d3eb-41d2-abc4-b51e4ce99515_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/bbd3bf9f-af32-40d5-a619-59052939abf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/55ce5e3f-64c6-41da-a7c1-b5da6e0a73be_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/8a5e8b82-8420-4caa-bdfa-9fc633a14abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/f135c5f8-9528-4251-8a43-3a5797d37141_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/416b837a-32cf-4ff2-b2d5-02e20d4ea7e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/fcbe1d9c-0a17-4c0e-a51d-4049693bfbe0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/6081ad37-943c-4d52-8ed5-d6742f3d91c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/47771959-6179-46dd-a6fb-b84941885fc7_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 10/19- 13K, 11/20- 21K, 10/21- 30K, 10/22- 43K, 12/23- 59K, 09/25- 82K', 'remarks': '**1487** VOSA STATES 30K, 43K, 56K, 57K, 68K, 82K,', 'virtual': False, 'seller': 'Part of United Rental Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa3ba111-87aa-4f44-b9f8-6f4d862e94d5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2025-12-03 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117444372, 'registration': 'NL68UEV', 'account': '442001', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 83632, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-09-26', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL68UEV/2025-11-24/image/1e233e8b-d3eb-41d2-abc4-b51e4ce99515_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/bbd3bf9f-af32-40d5-a619-59052939abf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/55ce5e3f-64c6-41da-a7c1-b5da6e0a73be_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/8a5e8b82-8420-4caa-bdfa-9fc633a14abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/f135c5f8-9528-4251-8a43-3a5797d37141_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/416b837a-32cf-4ff2-b2d5-02e20d4ea7e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/fcbe1d9c-0a17-4c0e-a51d-4049693bfbe0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/6081ad37-943c-4d52-8ed5-d6742f3d91c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68UEV/2025-11-24/image/47771959-6179-46dd-a6fb-b84941885fc7_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 10/19- 13K, 11/20- 21K, 10/21- 30K, 10/22- 43K, 12/23- 59K, 09/25- 82K', 'remarks': '**1487** VOSA STATES 30K, 43K, 56K, 57K, 68K, 82K,', 'virtual': False, 'seller': 'Part of United Rental Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa3ba111-87aa-4f44-b9f8-6f4d862e94d5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2025-12-03 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aadcf58a-380a-5c2b-b71b-8445b23a466a with identifier: 117444372
2025-12-03 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aadcf58a-380a-5c2b-b71b-8445b23a466a with scrape type 2
2025-12-03 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aadcf58a-380a-5c2b-b71b-8445b23a466a with scrape type 2
2025-12-03 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aadcf58a-380a-5c2b-b71b-8445b23a466a, identifier: 117444372
2025-12-03 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/64b6dd6c-c577-4297-922e-19ecd182adeb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117641062?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c3cc96e3-1926-5b51-bfea-ef9da46a57a6 with identifier: 117730170
2025-12-03 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c3cc96e3-1926-5b51-bfea-ef9da46a57a6 with identifier: 117730170
2025-12-03 19:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c3cc96e3-1926-5b51-bfea-ef9da46a57a6 with identifier: 117730170 to the API
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c3cc96e3-1926-5b51-bfea-ef9da46a57a6%27 HTTP/1.1" 200 None
2025-12-03 19:02:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c3cc96e3-1926-5b51-bfea-ef9da46a57a6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117730170?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'c3cc96e3-1926-5b51-bfea-ef9da46a57a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG69KXA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117730170',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'KIA',
 'model': 'OPTIMA DIESEL SPORTSWAGON',
 'odometer': 84369,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-08',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'KIA OPTIMA DIESEL SPORTSWAGON 1.6 CRDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi ISG 2 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117730170%27 HTTP/1.1" 200 None
2025-12-03 19:02:43 [astonbarclay.gb] INFO: Saving data for 117730170: {'created_time': 1764788563.109008, 'last_price_update_time': 1764788563.10902, 'auction_closing_time': 1765359900.0}
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117730170') HTTP/1.1" 204 0
2025-12-03 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aadcf58a-380a-5c2b-b71b-8445b23a466a with identifier: 117444372
2025-12-03 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aadcf58a-380a-5c2b-b71b-8445b23a466a with identifier: 117444372
2025-12-03 19:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aadcf58a-380a-5c2b-b71b-8445b23a466a with identifier: 117444372 to the API
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27aadcf58a-380a-5c2b-b71b-8445b23a466a%27 HTTP/1.1" 200 None
2025-12-03 19:02:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id aadcf58a-380a-5c2b-b71b-8445b23a466a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117444372?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'aadcf58a-380a-5c2b-b71b-8445b23a466a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NL68UEV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117444372',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 83632,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-26',
 'seller_name': 'Part of United Rental Group',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Excite 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Excite 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444372%27 HTTP/1.1" 200 None
2025-12-03 19:02:43 [astonbarclay.gb] INFO: Saving data for 117444372: {'auction_closing_time': 1764936000.0, 'created_time': 1764010915.596856, 'last_price_update_time': 1764788563.390153}
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117444372') HTTP/1.1" 204 0
2025-12-03 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f79e290>
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/a92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:43 [astonbarclay.gb] INFO: Found listing with ID: 117551002
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551002%27 HTTP/1.1" 200 None
2025-12-03 19:02:43 [astonbarclay.gb] INFO: Scrape type for 117551002: 1
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f86a1d0>
2025-12-03 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSY68YLV%252F2025-12-03%252Fimage%252Ffd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27e1e069-b0dd-5530-b02e-4f38e0873349
2025-12-03 19:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27e1e069-b0dd-5530-b02e-4f38e0873349, skipping ID generation
2025-12-03 19:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e1e069-b0dd-5530-b02e-4f38e0873349 with scrape type 1
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 27e1e069-b0dd-5530-b02e-4f38e0873349 from tracking dictionaries
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27e1e069-b0dd-5530-b02e-4f38e0873349 sending to next pipeline
2025-12-03 19:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 27e1e069-b0dd-5530-b02e-4f38e0873349, identifier: 117733240
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f87c790>
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fde89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/de89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg?w=600 saved to cache
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee30b90>
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_17.jpg HTTP/1.1" 201 0
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 27e1e069-b0dd-5530-b02e-4f38e0873349 with identifier: 117733240
2025-12-03 19:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 27e1e069-b0dd-5530-b02e-4f38e0873349 with identifier: 117733240
2025-12-03 19:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 27e1e069-b0dd-5530-b02e-4f38e0873349 with identifier: 117733240 to the API
2025-12-03 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '27e1e069-b0dd-5530-b02e-4f38e0873349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SY68YLV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117733240',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT DIESEL ESTATE',
 'odometer': 56125,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23312,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/2acbef47-3872-41b7-b44e-a77d24241ba4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24343,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/9fd1f1d6-aa1b-48c5-9382-60db0a563393_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24129,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/940dfd29-6bda-4b0a-95fb-b8d823ad8586_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24649,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4af4bd0b-17dd-45d1-9dd0-56c1f9d4bee2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34357,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/eccf2fe8-6624-4508-ba8e-68663273f107_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45110,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/7862d378-22b1-47a1-92a5-b5799a2aef6b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38405,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/4f0ea82f-9827-435b-aa19-872b75abce5b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43768,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/e0b5f8d1-d9f0-4167-8174-18d305a81a8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e1e069-b0dd-5530-b02e-4f38e0873349/27e1e069-b0dd-5530-b02e-4f38e0873349_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36625,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SY68YLV/2025-12-03/image/fd4b9b10-2751-41e7-ad09-a9cca6c1309c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-29',
 'seller_name': 'MotoNovo Finance',
 'title': 'LAND ROVER RANGE ROVER SPORT DIESEL ESTATE 3.0 SDV6 HSE Dynamic 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '3.0 SDV6 HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117733240%27 HTTP/1.1" 200 None
2025-12-03 19:02:45 [astonbarclay.gb] INFO: Saving data for 117733240: {'created_time': 1764788565.157609, 'last_price_update_time': 1764788565.157619, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117733240') HTTP/1.1" 204 0
2025-12-03 19:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec5b450>
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/c6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:45 [astonbarclay.gb] INFO: Found listing with ID: 117727318
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117727318%27 HTTP/1.1" 200 None
2025-12-03 19:02:45 [astonbarclay.gb] INFO: Scrape type for 117727318: 1
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7aa950>
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F64b6dd6c-c577-4297-922e-19ecd182adeb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/64b6dd6c-c577-4297-922e-19ecd182adeb.jpg?w=600 saved to cache
2025-12-03 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec5bb10>
2025-12-03 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_18.jpg HTTP/1.1" 201 0
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75e1d0>
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg?w=600 saved to cache
2025-12-03 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117641062, 'registration': 'LT18USE', 'account': 'SMC009', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.6 DiG-T Tekna 5dr', 'mileage': 132505, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-07', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6dd0244c-3416-426a-9b7e-81daadc0f112.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117641062, 'registration': 'LT18USE', 'account': 'SMC009', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.6 DiG-T Tekna 5dr', 'mileage': 132505, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-07', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6dd0244c-3416-426a-9b7e-81daadc0f112.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bcbfc4-2933-515d-87df-11ad6bebece9 with identifier: 117641062
2025-12-03 19:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bcbfc4-2933-515d-87df-11ad6bebece9 with scrape type 1
2025-12-03 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a0bcbfc4-2933-515d-87df-11ad6bebece9
2025-12-03 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a0bcbfc4-2933-515d-87df-11ad6bebece9
2025-12-03 19:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a0bcbfc4-2933-515d-87df-11ad6bebece9, identifier: 117641062
2025-12-03 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a0bcbfc4-2933-515d-87df-11ad6bebece9 with identifier: 117641062
2025-12-03 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a0bcbfc4-2933-515d-87df-11ad6bebece9 with identifier: 117641062
2025-12-03 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'smc group', 'price_includes_vat': False, 'title': 'nissan x-trail station wagon 1.6 dig-t tekna 5dr', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'x-trail station wagon', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 132505, 'odometer_reading_unit': 'mi', 'registration_date': '2018-03-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641062', 'expiration_date': '2025-12-10t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.6 dig-t tekna 5dr', 'license_plate': 'lt18use', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 149, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a0bcbfc4-2933-515d-87df-11ad6bebece9', 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'nissan x-trail station wagon', 'sanitized_make': 'nissan', 'odometer_in_km': 213245}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 149,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-10t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'a0bcbfc4-2933-515d-87df-11ad6bebece9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lt18use',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641062',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'nissan',
     'make_model': 'nissan x-trail station wagon',
     'model': 'x-trail station wagon',
     'odometer': 132505,
     'odometer_in_km': 213245,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-03-07',
     'sanitized_make': 'nissan',
     'seller_name': 'smc group',
     'title': 'nissan x-trail station wagon 1.6 dig-t tekna 5dr',
     'transmission': 'manual',
     'trim': '1.6 dig-t tekna 5dr',
     'vin': None,
     'year': 2018}
2025-12-03 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a0bcbfc4-2933-515d-87df-11ad6bebece9 spider: astonbarclay.gb
2025-12-03 19:02:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a0bcbfc4-2933-515d-87df-11ad6bebece9 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'smc group', 'price_includes_vat': False, 'title': 'nissan x-trail station wagon 1.6 dig-t tekna 5dr', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'x-trail station wagon', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 132505, 'odometer_reading_unit': 'mi', 'registration_date': '2018-03-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641062', 'expiration_date': '2025-12-10t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.6 dig-t tekna 5dr', 'license_plate': 'lt18use', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 149, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a0bcbfc4-2933-515d-87df-11ad6bebece9', 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'nissan x-trail station wagon', 'sanitized_make': 'nissan', 'odometer_in_km': 213245}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 149,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-10t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'a0bcbfc4-2933-515d-87df-11ad6bebece9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lt18use',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641062',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'nissan',
     'make_model': 'nissan x-trail station wagon',
     'model': 'x-trail station wagon',
     'odometer': 132505,
     'odometer_in_km': 213245,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-03-07',
     'sanitized_make': 'nissan',
     'seller_name': 'smc group',
     'title': 'nissan x-trail station wagon 1.6 dig-t tekna 5dr',
     'transmission': 'manual',
     'trim': '1.6 dig-t tekna 5dr',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a0bcbfc4-2933-515d-87df-11ad6bebece9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT18USE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641062',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'X-TRAIL STATION WAGON',
 'odometer': 132505,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': 'SMC Group',
 'title': 'NISSAN X-TRAIL STATION WAGON 1.6 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.6 DiG-T Tekna 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641062%27 HTTP/1.1" 200 None
2025-12-03 19:02:46 [astonbarclay.gb] INFO: Saving data for 117641062: {'created_time': 1764788566.90449, 'last_price_update_time': 1764788566.9045, 'auction_closing_time': 1765360800.0}
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117641062') HTTP/1.1" 204 0
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6e5510>
2025-12-03 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg?w=600 saved to cache
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eccb690>
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_19.jpg HTTP/1.1" 201 0
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed5b9d0>
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252Fa92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/a92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117665271?view=catalogue)
2025-12-03 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:47 [astonbarclay.gb] INFO: Found listing with ID: 117695719
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695719%27 HTTP/1.1" 200 None
2025-12-03 19:02:47 [astonbarclay.gb] INFO: Scrape type for 117695719: 0
2025-12-03 19:02:47 [astonbarclay.gb] INFO: Found listing with ID: 117672857
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672857%27 HTTP/1.1" 200 None
2025-12-03 19:02:47 [astonbarclay.gb] INFO: Scrape type for 117672857: 1
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117632019?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb84a10>
2025-12-03 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252F6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff18a50>
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252F7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee01dd0>
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg?w=600 saved to cache
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117697673?view=catalogue)
2025-12-03 19:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebf9ed0>
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252Fc6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/c6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:48 [astonbarclay.gb] INFO: Found listing with ID: 117641049
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641049%27 HTTP/1.1" 200 None
2025-12-03 19:02:48 [astonbarclay.gb] INFO: Scrape type for 117641049: 1
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252Fdbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee82810>
2025-12-03 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg?w=600 saved to cache
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117635166, 'registration': 'LY18ZBW', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 250d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 68337, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-24', 'fuel': 'Diesel', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/ef282d63-2794-440d-9da2-a062793ef9cf.jpg?w=600', 'https://abimg002.imgix.net/d5803044-7e49-491a-82cd-a23aedc2d502.jpg?w=600', 'https://abimg002.imgix.net/3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg?w=600', 'https://abimg002.imgix.net/a9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg?w=600', 'https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600', 'https://abimg002.imgix.net/e85a823c-df47-404e-9d9c-8d6488f054eb.jpg?w=600', 'https://abimg002.imgix.net/9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bcc06dd0-030a-42cb-ba4d-9bd8d3f2fdf9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117635166, 'registration': 'LY18ZBW', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 250d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 68337, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-24', 'fuel': 'Diesel', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/ef282d63-2794-440d-9da2-a062793ef9cf.jpg?w=600', 'https://abimg002.imgix.net/d5803044-7e49-491a-82cd-a23aedc2d502.jpg?w=600', 'https://abimg002.imgix.net/3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg?w=600', 'https://abimg002.imgix.net/a9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg?w=600', 'https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600', 'https://abimg002.imgix.net/e85a823c-df47-404e-9d9c-8d6488f054eb.jpg?w=600', 'https://abimg002.imgix.net/9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bcc06dd0-030a-42cb-ba4d-9bd8d3f2fdf9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b7e09c-15c8-549e-bc18-af6ef5591e0a with identifier: 117635166
2025-12-03 19:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a with scrape type 1
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fef282d63-2794-440d-9da2-a062793ef9cf.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ef282d63-2794-440d-9da2-a062793ef9cf.jpg?w=600 not downloaded yet
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75bf90>
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Fc2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f793b10>
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F15588c82-4d36-469a-b2d1-0f75aa97840e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600 saved to cache
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1a351001-4d21-5794-b75d-785b55d13336
2025-12-03 19:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a351001-4d21-5794-b75d-785b55d13336, skipping ID generation
2025-12-03 19:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a351001-4d21-5794-b75d-785b55d13336 with scrape type 1
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a351001-4d21-5794-b75d-785b55d13336 from tracking dictionaries
2025-12-03 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a351001-4d21-5794-b75d-785b55d13336 sending to next pipeline
2025-12-03 19:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1a351001-4d21-5794-b75d-785b55d13336, identifier: 117665271
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec32950>
2025-12-03 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117632019, 'registration': 'LV24YDJ', 'account': 'STE096', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Excel 5dr CVT', 'mileage': 3968, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-03-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg?w=600', 'https://abimg002.imgix.net/86751435-d13d-45c9-b293-9f6933c442d8.jpg?w=600', 'https://abimg002.imgix.net/e24a717d-460d-49aa-afdb-7589a3b05eff.jpg?w=600', 'https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9fa1f3b2-e81a-4dc8-ad58-ec7e6c1a6ec6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117632019, 'registration': 'LV24YDJ', 'account': 'STE096', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Excel 5dr CVT', 'mileage': 3968, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-03-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg?w=600', 'https://abimg002.imgix.net/86751435-d13d-45c9-b293-9f6933c442d8.jpg?w=600', 'https://abimg002.imgix.net/e24a717d-460d-49aa-afdb-7589a3b05eff.jpg?w=600', 'https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9fa1f3b2-e81a-4dc8-ad58-ec7e6c1a6ec6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e4027e-2adf-52c0-bfa8-8c2281970604 with identifier: 117632019
2025-12-03 19:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e4027e-2adf-52c0-bfa8-8c2281970604 with scrape type 1
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 61e4027e-2adf-52c0-bfa8-8c2281970604
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg?w=600 not downloaded yet
2025-12-03 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702364?view=catalogue)
2025-12-03 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 117623603
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623603%27 HTTP/1.1" 200 None
2025-12-03 19:02:50 [astonbarclay.gb] INFO: Scrape type for 117623603: 1
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd5803044-7e49-491a-82cd-a23aedc2d502.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d5803044-7e49-491a-82cd-a23aedc2d502.jpg?w=600 not downloaded yet
2025-12-03 19:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1a351001-4d21-5794-b75d-785b55d13336 with identifier: 117665271
2025-12-03 19:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1a351001-4d21-5794-b75d-785b55d13336 with identifier: 117665271
2025-12-03 19:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1a351001-4d21-5794-b75d-785b55d13336 with identifier: 117665271 to the API
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1a351001-4d21-5794-b75d-785b55d13336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SV18OPP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117665271',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '5008 ESTATE',
 'odometer': 51538,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64795,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/f7c4632c-9720-4bda-a739-22d02e89261f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58549,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/7cc8eb5b-fe8a-4235-8a48-53f5d061732c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48824,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/5fdd0590-27b4-4420-a56e-b275acbd01a9.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55671,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/7cfd205b-3963-4fbd-9e0b-5891521eaf81.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49939,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/801b7b90-5ec3-4a24-a752-40b73612620c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65910,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/90899e93-1422-46f8-9076-3f2d161172fd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63273,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/f2a1311d-6e1e-454a-a1e4-ab90ed8548cd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59708,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/de89e2a9-34b2-4f7e-a2ab-cd370bed278f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60275,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/64b6dd6c-c577-4297-922e-19ecd182adeb.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47966,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/642578b0-30e5-4039-9cc4-03d732ecc4c1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60735,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/4e3331d8-23f8-445a-bdf8-2ca70cac0ef0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a351001-4d21-5794-b75d-785b55d13336/1a351001-4d21-5794-b75d-785b55d13336_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42510,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/15588c82-4d36-469a-b2d1-0f75aa97840e.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': 'Vantage Motor Group',
 'title': 'PEUGEOT 5008 ESTATE 1.6 THP GT Line 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.6 THP GT Line 5dr EAT6',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117665271%27 HTTP/1.1" 200 None
2025-12-03 19:02:50 [astonbarclay.gb] INFO: Saving data for 117665271: {'created_time': 1764788570.549829, 'last_price_update_time': 1764788570.549838, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117665271') HTTP/1.1" 204 0
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb04250>
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Fd6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9ec490>
2025-12-03 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eafae50>
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600 saved to cache
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54ef3661-d415-509b-9f68-bae992689b81
2025-12-03 19:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54ef3661-d415-509b-9f68-bae992689b81, skipping ID generation
2025-12-03 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54ef3661-d415-509b-9f68-bae992689b81 with scrape type 1
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 54ef3661-d415-509b-9f68-bae992689b81 from tracking dictionaries
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54ef3661-d415-509b-9f68-bae992689b81 sending to next pipeline
2025-12-03 19:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 54ef3661-d415-509b-9f68-bae992689b81, identifier: 117697673
2025-12-03 19:02:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117703363, 'registration': 'FV69OVZ', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK SPECIAL EDS', 'derivative': '1.4T 16V 150 Griffin 5dr Auto [Start Stop]', 'mileage': 52973, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-26', 'fuel': 'Petrol', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/ec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/cc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/b6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/21- 4K, 06/21- 7K, 11/23- 36K, 11/24- 43K', 'remarks': 'VOSA STATES 27K, 36K, 43K, 52K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/15ebe6ed-2050-4fdb-9cc9-d245fb5ea85c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117703363, 'registration': 'FV69OVZ', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK SPECIAL EDS', 'derivative': '1.4T 16V 150 Griffin 5dr Auto [Start Stop]', 'mileage': 52973, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-26', 'fuel': 'Petrol', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/ec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/cc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/b6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/21- 4K, 06/21- 7K, 11/23- 36K, 11/24- 43K', 'remarks': 'VOSA STATES 27K, 36K, 43K, 52K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/15ebe6ed-2050-4fdb-9cc9-d245fb5ea85c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b with identifier: 117703363
2025-12-03 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b with scrape type 1
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117686371, 'registration': 'LL16YKB', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL COUPE', 'derivative': 'C250d AMG Line Premium Plus 2dr Auto', 'mileage': 70689, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-25', 'fuel': 'Diesel', 'motExpiry': '2026-04-09', 'doors': 2, 'engineSize': 2143, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/abd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/aaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/e1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/17- 24K, 12/18- 31K, 01/20- 37K, 03/22- 41K, 03/23- 45K, 04/24- 55K, 04/25- 63K', 'remarks': 'VOSA STATES 41K, 45K, 55K, 63K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117686371, 'registration': 'LL16YKB', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL COUPE', 'derivative': 'C250d AMG Line Premium Plus 2dr Auto', 'mileage': 70689, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-25', 'fuel': 'Diesel', 'motExpiry': '2026-04-09', 'doors': 2, 'engineSize': 2143, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/abd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/aaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/e1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/17- 24K, 12/18- 31K, 01/20- 37K, 03/22- 41K, 03/23- 45K, 04/24- 55K, 04/25- 63K', 'remarks': 'VOSA STATES 41K, 45K, 55K, 63K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bdaf28-e84c-51b6-ab89-00076b814301 with identifier: 117686371
2025-12-03 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bdaf28-e84c-51b6-ab89-00076b814301 with scrape type 1
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Ff3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195495?view=catalogue)
2025-12-03 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117701765?view=catalogue)
2025-12-03 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F86751435-d13d-45c9-b293-9f6933c442d8.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/86751435-d13d-45c9-b293-9f6933c442d8.jpg?w=600 not downloaded yet
2025-12-03 19:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 54ef3661-d415-509b-9f68-bae992689b81 with identifier: 117697673
2025-12-03 19:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 54ef3661-d415-509b-9f68-bae992689b81 with identifier: 117697673
2025-12-03 19:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 54ef3661-d415-509b-9f68-bae992689b81 with identifier: 117697673 to the API
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '54ef3661-d415-509b-9f68-bae992689b81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK66MOV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117697673',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 27937,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101552,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/7197a583-c93d-4756-8ef0-f6824c3bfe92.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97335,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/062cc636-845d-4d2e-a731-984fd7197e58.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75922,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/247ecae1-083d-4b7e-b033-2dd9117badf3.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97775,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/d1be310f-2631-4ff6-8088-e7e260f5db50.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90016,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/6f82bf24-407e-4e99-ab8a-ae9456cc3214.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94947,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/2a6ab368-01c7-421c-9217-7c2488a39bd3.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ef3661-d415-509b-9f68-bae992689b81/54ef3661-d415-509b-9f68-bae992689b81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94178,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/86c9decd-3164-4d0e-b3a6-f31caece0e22.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': 'Vantage Motor Group',
 'title': 'BMW 2 SERIES ACTIVE TOURER 225xe Sport 5dr [Nav] Auto',
 'transmission': 'automatic',
 'trim': '225xe Sport 5dr [Nav] Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117697673%27 HTTP/1.1" 200 None
2025-12-03 19:02:52 [astonbarclay.gb] INFO: Saving data for 117697673: {'created_time': 1764788572.039104, 'last_price_update_time': 1764788572.039118, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117697673') HTTP/1.1" 204 0
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec1bdd0>
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:52 [astonbarclay.gb] INFO: Found listing with ID: 117707924
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707924%27 HTTP/1.1" 200 None
2025-12-03 19:02:52 [astonbarclay.gb] INFO: Scrape type for 117707924: 1
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg?w=600 not downloaded yet
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/ec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Fabd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/abd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117660491?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe24a717d-460d-49aa-afdb-7589a3b05eff.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e24a717d-460d-49aa-afdb-7589a3b05eff.jpg?w=600 not downloaded yet
2025-12-03 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee00cd0>
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600 saved to cache
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7faa3e6f-aabb-563b-aec6-b21599755065
2025-12-03 19:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7faa3e6f-aabb-563b-aec6-b21599755065, skipping ID generation
2025-12-03 19:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faa3e6f-aabb-563b-aec6-b21599755065 with scrape type 1
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7faa3e6f-aabb-563b-aec6-b21599755065 from tracking dictionaries
2025-12-03 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7faa3e6f-aabb-563b-aec6-b21599755065 sending to next pipeline
2025-12-03 19:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7faa3e6f-aabb-563b-aec6-b21599755065, identifier: 117702364
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebabe90>
2025-12-03 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9dfd90>
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:53 [astonbarclay.gb] INFO: Found listing with ID: 117719548
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117719548%27 HTTP/1.1" 200 None
2025-12-03 19:02:53 [astonbarclay.gb] INFO: Scrape type for 117719548: 1
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg?w=600 not downloaded yet
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7faa3e6f-aabb-563b-aec6-b21599755065 with identifier: 117702364
2025-12-03 19:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7faa3e6f-aabb-563b-aec6-b21599755065 with identifier: 117702364
2025-12-03 19:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7faa3e6f-aabb-563b-aec6-b21599755065 with identifier: 117702364 to the API
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '7faa3e6f-aabb-563b-aec6-b21599755065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PE16VTA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117702364',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER ESTATE',
 'odometer': 88876,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54763,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/4f2a588e-5b5e-48dd-ae8a-cff73e6500d4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56411,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/52e007c8-9d6a-431e-ae8c-5ba3588bc39c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39608,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/2297a7a3-af64-4599-89ae-8b0a3de7b57f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39515,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/2d1ba78b-fcba-4dcf-9363-af1b22c3059e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46114,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/0bff71f4-efcf-4b7d-8013-44952d28f322.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37484,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/8bb06c54-1e35-4fa1-86e7-facb0b25d78b.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40110,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/0b0ce7cb-cfb0-4307-832b-abe1c3e83944.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72588,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/cb439393-92ef-4e91-807c-952f3fd837f2.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53332,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/34377564-01fd-40f0-8557-fe44763244fd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faa3e6f-aabb-563b-aec6-b21599755065/7faa3e6f-aabb-563b-aec6-b21599755065_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57063,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/e6eaea09-efa9-404d-ae48-14767852cb70.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': 'Vantage Motor Group',
 'title': 'MITSUBISHI OUTLANDER ESTATE 2.0 PHEV GX4h 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 PHEV GX4h 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702364%27 HTTP/1.1" 200 None
2025-12-03 19:02:53 [astonbarclay.gb] INFO: Saving data for 117702364: {'created_time': 1764788573.812561, 'last_price_update_time': 1764788573.812573, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117702364') HTTP/1.1" 204 0
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cc55910>
2025-12-03 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE73WNP%252F2025-11-24%252Fimage%252Ff90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7
2025-12-03 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6a97766-adc5-50e1-914e-c1f39eb6b4b7, skipping ID generation
2025-12-03 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7 with scrape type 1
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a6a97766-adc5-50e1-914e-c1f39eb6b4b7 from tracking dictionaries
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6a97766-adc5-50e1-914e-c1f39eb6b4b7 sending to next pipeline
2025-12-03 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6a97766-adc5-50e1-914e-c1f39eb6b4b7, identifier: 117195495
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff09d90>
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB65XAM%252F2025-12-03%252Fimage%252F4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bc62219-6172-51aa-a171-ab470020458b
2025-12-03 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bc62219-6172-51aa-a171-ab470020458b, skipping ID generation
2025-12-03 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc62219-6172-51aa-a171-ab470020458b with scrape type 1
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7bc62219-6172-51aa-a171-ab470020458b from tracking dictionaries
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bc62219-6172-51aa-a171-ab470020458b sending to next pipeline
2025-12-03 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7bc62219-6172-51aa-a171-ab470020458b, identifier: 117701765
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8b2790>
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Ff46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117700117?view=catalogue)
2025-12-03 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ef282d63-2794-440d-9da2-a062793ef9cf.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600 not downloaded yet
2025-12-03 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6a97766-adc5-50e1-914e-c1f39eb6b4b7 with identifier: 117195495
2025-12-03 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6a97766-adc5-50e1-914e-c1f39eb6b4b7 with identifier: 117195495
2025-12-03 19:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6a97766-adc5-50e1-914e-c1f39eb6b4b7 with identifier: 117195495 to the API
2025-12-03 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': 'a6a97766-adc5-50e1-914e-c1f39eb6b4b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE73WNP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117195495',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 22104,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30863,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/93bf3d42-4dd2-4aeb-94f5-ac76176077b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29081,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/f90a131d-6054-4efb-a0e9-8cb077017d9b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32197,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/dcf25667-a799-403d-ab16-83d0a5d68f43_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31170,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/6310da0c-c8a4-4816-b232-b35265721d11_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45129,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/bcdbcaa4-c05a-4f34-ae79-711e8f3dab94_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54074,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/76adc8d5-f8fe-4344-a784-1d8d34a7523c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41492,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/65e3efe7-c1ce-4445-aa67-df7169d82aef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a97766-adc5-50e1-914e-c1f39eb6b4b7/a6a97766-adc5-50e1-914e-c1f39eb6b4b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56002,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE73WNP/2025-11-24/image/574295fa-e3b4-49f3-bbc3-5e2d1f657649_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-13',
 'seller_name': 'Mobilize Financial Services',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-Tech full hybrid 145 Evolution 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-Tech full hybrid 145 Evolution 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195495%27 HTTP/1.1" 200 None
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Saving data for 117195495: {'created_time': 1764788575.235809, 'last_price_update_time': 1764788575.235819, 'auction_closing_time': 1764842400.0}
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195495') HTTP/1.1" 204 0
2025-12-03 19:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7bc62219-6172-51aa-a171-ab470020458b with identifier: 117701765
2025-12-03 19:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7bc62219-6172-51aa-a171-ab470020458b with identifier: 117701765
2025-12-03 19:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7bc62219-6172-51aa-a171-ab470020458b with identifier: 117701765 to the API
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7bc62219-6172-51aa-a171-ab470020458b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB65XAM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117701765',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'CEED SPORTSWAGON SPECIAL EDITIONS',
 'odometer': 72083,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25697,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/172bc1ce-3948-4674-9244-341454fde5b7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28740,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/4fa03215-2b9f-4805-a002-6eab0d1a28fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26701,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/f96fddfd-0764-4ea1-8470-0d43d0d90bdf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26960,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/6f9ea39c-52de-4d02-9d97-78260eb61dc4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45591,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/616e1b0b-4257-4301-82ec-9ea10cd8f99a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73888,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/0ba5caf6-9fef-44f2-a08e-d6f07ddce086_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74728,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/bf245128-7082-48bc-80f1-4361894e9df6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50131,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d1c697d8-31ed-4860-91a5-d25094b45585_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc62219-6172-51aa-a171-ab470020458b/7bc62219-6172-51aa-a171-ab470020458b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41543,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LB65XAM/2025-12-03/image/d60a72aa-9d58-4949-8e57-0ca292a831ed_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'KIA CEED SPORTSWAGON SPECIAL EDITIONS 1.4 SR7 5dr',
 'transmission': 'manual',
 'trim': '1.4 SR7 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117701765%27 HTTP/1.1" 200 None
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Saving data for 117701765: {'created_time': 1764788575.648379, 'last_price_update_time': 1764788575.648388, 'auction_closing_time': 1765188000.0}
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117701765') HTTP/1.1" 204 0
2025-12-03 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8b5910>
2025-12-03 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252F58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632019?view=catalogue)
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 117660374
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660374%27 HTTP/1.1" 200 None
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Scrape type for 117660374: 0
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 117651744
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651744%27 HTTP/1.1" 200 None
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Scrape type for 117651744: 0
2025-12-03 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 117681445
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681445%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Scrape type for 117681445: 1
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fbe2cf534-0177-43f0-9f0d-a23043756f14.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fcc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/cc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117551156?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117458552?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117686613, 'registration': 'CF19RKJ', 'account': 'WBA002', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 38180, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-01', 'fuel': 'Petrol', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/20695be5-ecf5-485e-a991-740714784946_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 09/20- ??, 06/22- ??, 06/23- 24K, 06/24- 30K, 06/25- 35K', 'remarks': 'VOSA STATES 16K, 24K, 30K, 35K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/afb76b25-eb91-4bc1-b3e2-098ac9222d9e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117686613, 'registration': 'CF19RKJ', 'account': 'WBA002', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 38180, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-01', 'fuel': 'Petrol', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/20695be5-ecf5-485e-a991-740714784946_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 09/20- ??, 06/22- ??, 06/23- 24K, 06/24- 30K, 06/25- 35K', 'remarks': 'VOSA STATES 16K, 24K, 30K, 35K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/afb76b25-eb91-4bc1-b3e2-098ac9222d9e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bebe1a9-a055-56aa-ab66-495c354ae9fe with identifier: 117686613
2025-12-03 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe with scrape type 1
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117646620, 'registration': 'SF19AXX', 'account': 'VAN040', 'make': 'PEUGEOT', 'model': 'PARTNER TEPEE', 'derivative': '1.6 BlueHDi 100 Active 5dr ETG', 'mileage': 32350, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-25', 'fuel': 'Diesel', 'motExpiry': '2026-04-24', 'doors': 5, 'engineSize': 1600, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg?w=600', 'https://abimg002.imgix.net/90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg?w=600', 'https://abimg002.imgix.net/99463aee-ef7f-4157-9928-8caed52bd452.jpg?w=600', 'https://abimg002.imgix.net/8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg?w=600', 'https://abimg002.imgix.net/1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg?w=600', 'https://abimg002.imgix.net/5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg?w=600', 'https://abimg002.imgix.net/011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg?w=600', 'https://abimg002.imgix.net/a2ae52af-10fe-4404-a462-6504206846d0.jpg?w=600', 'https://abimg002.imgix.net/bed26706-0c72-497a-9a74-8e5fd55d7b29.jpg?w=600', 'https://abimg002.imgix.net/b24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg?w=600', 'https://abimg002.imgix.net/8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg?w=600', 'https://abimg002.imgix.net/84510207-ea8d-4061-8ec2-a34b1950fe34.jpg?w=600', 'https://abimg002.imgix.net/0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg?w=600', 'https://abimg002.imgix.net/3b382c93-34e7-4544-8183-abe3ef50f5df.jpg?w=600', 'https://abimg002.imgix.net/1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg?w=600', 'https://abimg002.imgix.net/4626b177-ee4e-4994-af45-23ff6c585f87.jpg?w=600', 'https://abimg002.imgix.net/f59df7e8-9611-41e0-83ea-00a41393c9a2.jpg?w=600'], 'colour': 'Silver', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 4K, 12K, 20K, 27K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117646620, 'registration': 'SF19AXX', 'account': 'VAN040', 'make': 'PEUGEOT', 'model': 'PARTNER TEPEE', 'derivative': '1.6 BlueHDi 100 Active 5dr ETG', 'mileage': 32350, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-25', 'fuel': 'Diesel', 'motExpiry': '2026-04-24', 'doors': 5, 'engineSize': 1600, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg?w=600', 'https://abimg002.imgix.net/90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg?w=600', 'https://abimg002.imgix.net/99463aee-ef7f-4157-9928-8caed52bd452.jpg?w=600', 'https://abimg002.imgix.net/8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg?w=600', 'https://abimg002.imgix.net/1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg?w=600', 'https://abimg002.imgix.net/5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg?w=600', 'https://abimg002.imgix.net/011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg?w=600', 'https://abimg002.imgix.net/a2ae52af-10fe-4404-a462-6504206846d0.jpg?w=600', 'https://abimg002.imgix.net/bed26706-0c72-497a-9a74-8e5fd55d7b29.jpg?w=600', 'https://abimg002.imgix.net/b24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg?w=600', 'https://abimg002.imgix.net/8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg?w=600', 'https://abimg002.imgix.net/84510207-ea8d-4061-8ec2-a34b1950fe34.jpg?w=600', 'https://abimg002.imgix.net/0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg?w=600', 'https://abimg002.imgix.net/3b382c93-34e7-4544-8183-abe3ef50f5df.jpg?w=600', 'https://abimg002.imgix.net/1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg?w=600', 'https://abimg002.imgix.net/4626b177-ee4e-4994-af45-23ff6c585f87.jpg?w=600', 'https://abimg002.imgix.net/f59df7e8-9611-41e0-83ea-00a41393c9a2.jpg?w=600'], 'colour': 'Silver', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 4K, 12K, 20K, 27K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1296ac9e-04ac-5736-add0-9dd6a567e1d2 with identifier: 117646620
2025-12-03 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2 with scrape type 1
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117660491, 'registration': 'WR21SZO', 'account': 'ESS039', 'make': 'SKODA', 'model': 'KAROQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG', 'mileage': 39516, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-05-12', 'fuel': 'Petrol', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3853a13a-13b4-4e3e-80b6-a312b97f6734.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117660491, 'registration': 'WR21SZO', 'account': 'ESS039', 'make': 'SKODA', 'model': 'KAROQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG', 'mileage': 39516, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-05-12', 'fuel': 'Petrol', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3853a13a-13b4-4e3e-80b6-a312b97f6734.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac02e56b-4435-53df-a4b4-9fda27b2f6c7 with identifier: 117660491
2025-12-03 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac02e56b-4435-53df-a4b4-9fda27b2f6c7 with scrape type 1
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ac02e56b-4435-53df-a4b4-9fda27b2f6c7
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ac02e56b-4435-53df-a4b4-9fda27b2f6c7
2025-12-03 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ac02e56b-4435-53df-a4b4-9fda27b2f6c7, identifier: 117660491
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee15350>
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ac02e56b-4435-53df-a4b4-9fda27b2f6c7 with identifier: 117660491
2025-12-03 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ac02e56b-4435-53df-a4b4-9fda27b2f6c7 with identifier: 117660491
2025-12-03 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ac02e56b-4435-53df-a4b4-9fda27b2f6c7 with identifier: 117660491 to the API
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ac02e56b-4435-53df-a4b4-9fda27b2f6c7%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ac02e56b-4435-53df-a4b4-9fda27b2f6c7: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:56 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117660491?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ac02e56b-4435-53df-a4b4-9fda27b2f6c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WR21SZO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117660491',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KAROQ ESTATE',
 'odometer': 39516,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seller_name': 'SMC Group',
 'title': 'SKODA KAROQ ESTATE 1.5 TSI SE L 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI SE L 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660491%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Saving data for 117660491: {'created_time': 1764788576.746641, 'last_price_update_time': 1764788576.746653, 'auction_closing_time': 1765360800.0}
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117660491') HTTP/1.1" 204 0
2025-12-03 19:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/86751435-d13d-45c9-b293-9f6933c442d8.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632019?view=catalogue)
2025-12-03 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d5803044-7e49-491a-82cd-a23aedc2d502.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Found listing with ID: 117689641
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117689641%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [astonbarclay.gb] INFO: Scrape type for 117689641: 1
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe85a823c-df47-404e-9d9c-8d6488f054eb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e85a823c-df47-404e-9d9c-8d6488f054eb.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fb6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/b6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Faaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/aaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg?w=600 not downloaded yet
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede8850>
2025-12-03 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebf2b10>
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML18UVA%252F2025-12-03%252Fimage%252Fdbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d
2025-12-03 19:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f51bdba-b430-55c5-b60e-f9e201e6b17d, skipping ID generation
2025-12-03 19:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d with scrape type 1
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5f51bdba-b430-55c5-b60e-f9e201e6b17d from tracking dictionaries
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f51bdba-b430-55c5-b60e-f9e201e6b17d sending to next pipeline
2025-12-03 19:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5f51bdba-b430-55c5-b60e-f9e201e6b17d, identifier: 117700117
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecb1810>
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edeb750>
2025-12-03 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fef282d63-2794-440d-9da2-a062793ef9cf.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ef282d63-2794-440d-9da2-a062793ef9cf.jpg?w=600 saved to cache
2025-12-03 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:02:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117727318, 'registration': 'SH16AZU', 'account': 'SMC010', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL HATCHBACK', 'derivative': '1.6 CDTi Elite Nav 5dr Auto', 'mileage': 31080, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-04-20', 'fuel': 'Diesel', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SH16AZU/2025-12-03/image/23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/c2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/bbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/18 16K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 26K, 28K, 29K, 29K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/338b245c-5fd5-4abe-9a55-36ad9e4399a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117727318, 'registration': 'SH16AZU', 'account': 'SMC010', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL HATCHBACK', 'derivative': '1.6 CDTi Elite Nav 5dr Auto', 'mileage': 31080, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-04-20', 'fuel': 'Diesel', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SH16AZU/2025-12-03/image/23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/c2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/bbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/18 16K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 26K, 28K, 29K, 29K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/338b245c-5fd5-4abe-9a55-36ad9e4399a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0b97f82-19b4-545b-9168-4ab99e82faf7 with identifier: 117727318
2025-12-03 19:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0b97f82-19b4-545b-9168-4ab99e82faf7 with scrape type 1
2025-12-03 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/abd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/ec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5f51bdba-b430-55c5-b60e-f9e201e6b17d with identifier: 117700117
2025-12-03 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5f51bdba-b430-55c5-b60e-f9e201e6b17d with identifier: 117700117
2025-12-03 19:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5f51bdba-b430-55c5-b60e-f9e201e6b17d with identifier: 117700117 to the API
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5f51bdba-b430-55c5-b60e-f9e201e6b17d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ML18UVA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700117',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 66909,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26329,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/52ea044f-4ec1-4bab-b195-a36f483b3f7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26402,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/57915566-ac7c-4419-8288-38c7cd7182f6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25872,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/a92dab64-d73d-4ee4-9bed-e98409b4e0f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26939,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/c6d94599-346d-4c9b-811f-d374b303e703_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45963,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/9a3e7d2c-54bf-47d9-b52a-d086a942abbf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49130,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/85fcda3b-2e03-4e55-822a-6c78ac5893b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41478,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/093e2cfc-afb6-4069-bb4a-57ddc0fe7ae5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43865,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/58ba09d5-5efe-41f2-a5be-71825759dbd5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f51bdba-b430-55c5-b60e-f9e201e6b17d/5f51bdba-b430-55c5-b60e-f9e201e6b17d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45550,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML18UVA/2025-12-03/image/dbd889ef-0617-4846-b7ba-d7dbd44c39ad_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-30',
 'seller_name': 'Vantage Motor Group',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700117%27 HTTP/1.1" 200 None
2025-12-03 19:02:58 [astonbarclay.gb] INFO: Saving data for 117700117: {'created_time': 1764788578.594866, 'last_price_update_time': 1764788578.594875, 'auction_closing_time': 1765285200.0}
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117700117') HTTP/1.1" 204 0
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb93b50>
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Ff3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg?w=600 saved to cache
2025-12-03 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed5de10>
2025-12-03 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg?w=600 saved to cache
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61e4027e-2adf-52c0-bfa8-8c2281970604
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117672857, 'registration': 'AV71WCX', 'account': 'MER178', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI Life 5dr DSG', 'mileage': 27762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-30', 'fuel': 'Petrol', 'motExpiry': '2025-12-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV71WCX/2025-12-03/image/5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/a3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/d3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae545066-3a20-439e-93a4-5e188d14ec08.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117672857, 'registration': 'AV71WCX', 'account': 'MER178', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI Life 5dr DSG', 'mileage': 27762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-30', 'fuel': 'Petrol', 'motExpiry': '2025-12-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV71WCX/2025-12-03/image/5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/a3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/d3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae545066-3a20-439e-93a4-5e188d14ec08.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12db2f7-7f23-5d58-8eb2-7f6d91594d8f with identifier: 117672857
2025-12-03 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f with scrape type 1
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117551156, 'registration': 'GX17XZH', 'account': 'NUN002', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Nav 5dr', 'mileage': 117064, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX17XZH/2025-12-01/image/a383ae95-4c5e-4c42-992d-a8ab4b3bed16_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/88937c41-4fb4-4b06-9795-6970a40f6911_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/8675d622-bb63-4f28-b011-ac6739897227_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f76829e6-5f5a-47e9-a06b-5c3d1e7255e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/1723056f-0794-44a9-90ba-470fe83fc19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f7d2e8bb-9988-4b98-8796-41b53799c560_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/0ab6ef0d-3447-4a7e-84c6-27ab5df681ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/55567941-35ab-4e6c-9c40-2bae3f0ab217_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/39218fbb-3343-413a-8d6a-392995362903_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/18 - 12K, 03/19 - 25K, 03/20 - 38K', 'remarks': '**1794** VOSA STATES 38K, 46K, 60K, 73K, 87K, 104K SD CARD', 'virtual': False, 'seller': 'Nunns Mazda', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c79456be-a657-4561-bfef-5e5eb09dbc0a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117551156, 'registration': 'GX17XZH', 'account': 'NUN002', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Nav 5dr', 'mileage': 117064, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX17XZH/2025-12-01/image/a383ae95-4c5e-4c42-992d-a8ab4b3bed16_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/88937c41-4fb4-4b06-9795-6970a40f6911_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/8675d622-bb63-4f28-b011-ac6739897227_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f76829e6-5f5a-47e9-a06b-5c3d1e7255e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/1723056f-0794-44a9-90ba-470fe83fc19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f7d2e8bb-9988-4b98-8796-41b53799c560_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/0ab6ef0d-3447-4a7e-84c6-27ab5df681ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/55567941-35ab-4e6c-9c40-2bae3f0ab217_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/39218fbb-3343-413a-8d6a-392995362903_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/18 - 12K, 03/19 - 25K, 03/20 - 38K', 'remarks': '**1794** VOSA STATES 38K, 46K, 60K, 73K, 87K, 104K SD CARD', 'virtual': False, 'seller': 'Nunns Mazda', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c79456be-a657-4561-bfef-5e5eb09dbc0a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e149115-2f07-5da3-88e4-fd336675ec2a with identifier: 117551156
2025-12-03 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e149115-2f07-5da3-88e4-fd336675ec2a with scrape type 2
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e149115-2f07-5da3-88e4-fd336675ec2a with scrape type 2
2025-12-03 19:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e149115-2f07-5da3-88e4-fd336675ec2a, identifier: 117551156
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117458552, 'registration': 'NL69NDV', 'account': 'DEP001', 'make': 'VOLVO', 'model': 'V90 ESTATE', 'derivative': '2.0 T8 [390] Hybrid R DESIGN Plus 5dr AWD Gtron', 'mileage': 89216, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-11', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-12-03', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL69NDV/2025-11-25/image/46eb76b6-cab4-4a34-8694-c2040f1054a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/42019448-0fa9-4e9d-95a1-10a700410600_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/283636ed-5f42-4d42-b0b9-011b66bdd638_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/7d52cc2c-ef09-465a-b393-725b332fbbd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/a714a2cc-10c1-4f96-96e4-4bfcae9ae6b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/18242fa7-bf02-463e-951e-3d84be829c2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/2bd04a37-c0bc-40cf-9134-6d60e8a09098_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/aefddd0d-eb11-4fc1-832d-17d1cdb1eeb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/8548f4f7-14ab-41e7-8f35-83b83ce9844a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/20- 8K, 08/21- 23K, 10/22- 40K, 11/24- 77K,', 'remarks': '**1626**VOSA STATES 40K, 59K, 62K, 77K CHARGING CABLE', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/20aaea8f-7f76-49fc-842c-b4af6bc8b50b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117458552, 'registration': 'NL69NDV', 'account': 'DEP001', 'make': 'VOLVO', 'model': 'V90 ESTATE', 'derivative': '2.0 T8 [390] Hybrid R DESIGN Plus 5dr AWD Gtron', 'mileage': 89216, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-11', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-12-03', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL69NDV/2025-11-25/image/46eb76b6-cab4-4a34-8694-c2040f1054a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/42019448-0fa9-4e9d-95a1-10a700410600_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/283636ed-5f42-4d42-b0b9-011b66bdd638_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/7d52cc2c-ef09-465a-b393-725b332fbbd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/a714a2cc-10c1-4f96-96e4-4bfcae9ae6b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/18242fa7-bf02-463e-951e-3d84be829c2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/2bd04a37-c0bc-40cf-9134-6d60e8a09098_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/aefddd0d-eb11-4fc1-832d-17d1cdb1eeb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL69NDV/2025-11-25/image/8548f4f7-14ab-41e7-8f35-83b83ce9844a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/20- 8K, 08/21- 23K, 10/22- 40K, 11/24- 77K,', 'remarks': '**1626**VOSA STATES 40K, 59K, 62K, 77K CHARGING CABLE', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/20aaea8f-7f76-49fc-842c-b4af6bc8b50b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d with identifier: 117458552
2025-12-03 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d with scrape type 2
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d with scrape type 2
2025-12-03 19:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d, identifier: 117458552
2025-12-03 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e24a717d-460d-49aa-afdb-7589a3b05eff.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632019?view=catalogue)
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 117699816
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699816%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Scrape type for 117699816: 1
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Fe1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/e1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F99463aee-ef7f-4157-9928-8caed52bd452.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/99463aee-ef7f-4157-9928-8caed52bd452.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252Fc2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/c2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e149115-2f07-5da3-88e4-fd336675ec2a with identifier: 117551156
2025-12-03 19:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e149115-2f07-5da3-88e4-fd336675ec2a with identifier: 117551156
2025-12-03 19:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188395 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188395
2025-12-03 19:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0e149115-2f07-5da3-88e4-fd336675ec2a spider: astonbarclay.gb
2025-12-03 19:02:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0e149115-2f07-5da3-88e4-fd336675ec2a due to rule: high_mileage_for_country.json, error: 188395 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188395
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e149115-2f07-5da3-88e4-fd336675ec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX17XZH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551156',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MAZDA',
 'model': 'CX-5 ESTATE',
 'odometer': 117064,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-13',
 'seller_name': 'Nunns Mazda',
 'title': 'MAZDA CX-5 ESTATE 2.0 Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '2.0 Sport Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551156%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [astonbarclay.gb] INFO: Saving data for 117551156: {'auction_closing_time': 1764936000.0, 'created_time': 1764356504.202705, 'last_price_update_time': 1764788579.715268}
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117551156') HTTP/1.1" 204 0
2025-12-03 19:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d with identifier: 117458552
2025-12-03 19:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d with identifier: 117458552
2025-12-03 19:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d with identifier: 117458552 to the API
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d%27 HTTP/1.1" 200 None
2025-12-03 19:02:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:02:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117458552?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b8faf4fd-a1c6-54e9-b1fb-dcf8a6a72d4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL69NDV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458552',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'V90 ESTATE',
 'odometer': 89216,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-11',
 'seller_name': 'Local dealer group',
 'title': 'VOLVO V90 ESTATE 2.0 T8 [390] Hybrid R DESIGN Plus 5dr AWD Gtron',
 'transmission': 'automatic',
 'trim': '2.0 T8 [390] Hybrid R DESIGN Plus 5dr AWD Gtron',
 'vin': None,
 'year': 2019}
2025-12-03 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458552%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [astonbarclay.gb] INFO: Saving data for 117458552: {'auction_closing_time': 1764936000.0, 'created_time': 1764010897.379689, 'last_price_update_time': 1764788580.007132}
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117458552') HTTP/1.1" 204 0
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f788990>
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563937?view=catalogue)
2025-12-03 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632019?view=catalogue)
2025-12-03 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fa3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/a3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117551002?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f792bd0>
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F86751435-d13d-45c9-b293-9f6933c442d8.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/86751435-d13d-45c9-b293-9f6933c442d8.jpg?w=600 saved to cache
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61e4027e-2adf-52c0-bfa8-8c2281970604
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed9d090>
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd5803044-7e49-491a-82cd-a23aedc2d502.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d5803044-7e49-491a-82cd-a23aedc2d502.jpg?w=600 saved to cache
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117699895
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699895%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117699895: 1
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg?w=600 not downloaded yet
2025-12-03 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edeb250>
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Fabd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/abd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed59350>
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/ec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/cc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee29550>
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f844110>
2025-12-03 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee2b350>
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg?w=600 saved to cache
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7eb350>
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe24a717d-460d-49aa-afdb-7589a3b05eff.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e24a717d-460d-49aa-afdb-7589a3b05eff.jpg?w=600 saved to cache
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61e4027e-2adf-52c0-bfa8-8c2281970604
2025-12-03 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/aaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 117613308
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613308%27 HTTP/1.1" 200 None
2025-12-03 19:03:02 [astonbarclay.gb] INFO: Scrape type for 117613308: 1
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Ff837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F20695be5-ecf5-485e-a991-740714784946_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/20695be5-ecf5-485e-a991-740714784946_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg?w=600 not downloaded yet
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede0c10>
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM22VGX%252F2025-12-03%252Fimage%252Fd3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60226794-c2fd-5847-9aa6-71873c5f1f67
2025-12-03 19:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60226794-c2fd-5847-9aa6-71873c5f1f67, skipping ID generation
2025-12-03 19:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60226794-c2fd-5847-9aa6-71873c5f1f67 with scrape type 1
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 60226794-c2fd-5847-9aa6-71873c5f1f67 from tracking dictionaries
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60226794-c2fd-5847-9aa6-71873c5f1f67 sending to next pipeline
2025-12-03 19:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60226794-c2fd-5847-9aa6-71873c5f1f67, identifier: 117563937
2025-12-03 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f835cd0>
2025-12-03 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600 saved to cache
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61e4027e-2adf-52c0-bfa8-8c2281970604
2025-12-03 19:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61e4027e-2adf-52c0-bfa8-8c2281970604, skipping ID generation
2025-12-03 19:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e4027e-2adf-52c0-bfa8-8c2281970604 with scrape type 1
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 61e4027e-2adf-52c0-bfa8-8c2281970604 from tracking dictionaries
2025-12-03 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61e4027e-2adf-52c0-bfa8-8c2281970604 sending to next pipeline
2025-12-03 19:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61e4027e-2adf-52c0-bfa8-8c2281970604, identifier: 117632019
2025-12-03 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cae6a50>
2025-12-03 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg?w=600 saved to cache
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:03:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623603, 'registration': 'AE68RZS', 'account': 'STE093', 'make': 'BMW', 'model': '1 SERIES HATCHBACK SPECIAL EDITION', 'derivative': '118i [1.5] M Sport Shadow Ed 5dr Step Auto', 'mileage': 23564, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-07', 'fuel': 'Petrol', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AE68RZS/2025-12-03/image/028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/045d13a0-9784-418b-a242-def546a7010f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/bc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/b064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/c3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8a10e78-0be7-47dd-95d5-eb0aa1afab16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623603, 'registration': 'AE68RZS', 'account': 'STE093', 'make': 'BMW', 'model': '1 SERIES HATCHBACK SPECIAL EDITION', 'derivative': '118i [1.5] M Sport Shadow Ed 5dr Step Auto', 'mileage': 23564, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-07', 'fuel': 'Petrol', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AE68RZS/2025-12-03/image/028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/045d13a0-9784-418b-a242-def546a7010f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/bc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/b064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/c3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8a10e78-0be7-47dd-95d5-eb0aa1afab16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e813d4-fe3f-5867-8e7b-bd5d8894a606 with identifier: 117623603
2025-12-03 19:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606 with scrape type 1
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117551002, 'registration': 'GF17EVP', 'account': 'SMC009', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 82 Allure 5dr', 'mileage': 108276, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/92940eee-9374-4319-af2b-eb8127f8414b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117551002, 'registration': 'GF17EVP', 'account': 'SMC009', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 82 Allure 5dr', 'mileage': 108276, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/92940eee-9374-4319-af2b-eb8127f8414b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4966d23e-639e-50b2-8def-e92f7e7a4aa0 with identifier: 117551002
2025-12-03 19:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4966d23e-639e-50b2-8def-e92f7e7a4aa0 with scrape type 1
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4966d23e-639e-50b2-8def-e92f7e7a4aa0
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4966d23e-639e-50b2-8def-e92f7e7a4aa0
2025-12-03 19:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4966d23e-639e-50b2-8def-e92f7e7a4aa0, identifier: 117551002
2025-12-03 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/b6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fe26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60226794-c2fd-5847-9aa6-71873c5f1f67 with identifier: 117563937
2025-12-03 19:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60226794-c2fd-5847-9aa6-71873c5f1f67 with identifier: 117563937
2025-12-03 19:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60226794-c2fd-5847-9aa6-71873c5f1f67 with identifier: 117563937 to the API
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '60226794-c2fd-5847-9aa6-71873c5f1f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM22VGX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563937',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 25388,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35038,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/d3cbd6bd-a32b-4a8c-a5d8-0803ffb7d74d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35976,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f46fed3c-afc4-491b-8b3b-66e42c103e5f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36433,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/8e351329-b138-41a4-aaf6-dbb251d675cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35834,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/7f2e452f-8260-4415-8f7d-534024f4ae13_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36471,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/f961579a-4f59-45d1-999e-76297043140a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19112,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6a2b7998-6485-4981-ba76-e0252fd429d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58101,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5ee4c2d3-8079-47ec-945f-c6f1b32dc769_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64164,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c200ec63-efc0-4d27-bef7-00eac653fa1e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75626,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2c744e02-6b8d-4f9d-8831-3313221a4a77_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54093,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/2de29307-aee1-4a63-ab2c-a85df679d3c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45495,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/500936f7-cdf0-4b4e-8986-6822d5aa3eff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43584,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/6770a118-1a40-47a7-a0bc-dcbd92aa2090_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40082,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/62c2f95d-a76b-46ef-939d-6508748db029_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54272,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/c5077dcb-9d34-44b2-9b47-6839e43f2b5a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32769,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/5a32ffd8-7dd5-445f-8bf0-685e0d35ad51_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25865,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b2793d6-d2cd-4430-ac78-a367a40a6238_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55924,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/52a610d5-cd73-4e7d-816e-ac18539a606d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49274,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/3b669cd7-9502-4631-b130-df71c94c9cf3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26085,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/438733d2-ebb1-40b3-a6c2-59c0dab814d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60226794-c2fd-5847-9aa6-71873c5f1f67/60226794-c2fd-5847-9aa6-71873c5f1f67_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50324,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/LM22VGX/2025-12-03/image/57afbd0d-a4e5-4389-85c9-611d68ecc7a2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto',
 'transmission': 'automatic',
 'trim': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563937%27 HTTP/1.1" 200 None
2025-12-03 19:03:04 [astonbarclay.gb] INFO: Saving data for 117563937: {'created_time': 1764788584.780602, 'last_price_update_time': 1764788584.780612, 'auction_closing_time': 1765275300.0}
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563937') HTTP/1.1" 204 0
2025-12-03 19:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61e4027e-2adf-52c0-bfa8-8c2281970604 with identifier: 117632019
2025-12-03 19:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61e4027e-2adf-52c0-bfa8-8c2281970604 with identifier: 117632019
2025-12-03 19:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 61e4027e-2adf-52c0-bfa8-8c2281970604 with identifier: 117632019 to the API
2025-12-03 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '61e4027e-2adf-52c0-bfa8-8c2281970604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV24YDJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117632019',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'YARIS HATCHBACK',
 'odometer': 3968,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93199,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/9c1d2a55-a67e-47d0-9fc1-8290021a815f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80258,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/86751435-d13d-45c9-b293-9f6933c442d8.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67984,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/e24a717d-460d-49aa-afdb-7589a3b05eff.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61e4027e-2adf-52c0-bfa8-8c2281970604/61e4027e-2adf-52c0-bfa8-8c2281970604_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55198,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/f00032b1-89c0-4957-baae-0f6d6d4a89a9.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-20',
 'seller_name': 'Hedin Automotive Mini',
 'title': 'TOYOTA YARIS HATCHBACK 1.5 Hybrid Excel 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Excel 5dr CVT',
 'vin': None,
 'year': 2024}
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632019%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [astonbarclay.gb] INFO: Saving data for 117632019: {'created_time': 1764788585.182583, 'last_price_update_time': 1764788585.182596, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117632019') HTTP/1.1" 204 0
2025-12-03 19:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4966d23e-639e-50b2-8def-e92f7e7a4aa0 with identifier: 117551002
2025-12-03 19:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4966d23e-639e-50b2-8def-e92f7e7a4aa0 with identifier: 117551002
2025-12-03 19:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174252 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174252
2025-12-03 19:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4966d23e-639e-50b2-8def-e92f7e7a4aa0 spider: astonbarclay.gb
2025-12-03 19:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4966d23e-639e-50b2-8def-e92f7e7a4aa0 due to rule: high_mileage_for_country.json, error: 174252 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174252
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4966d23e-639e-50b2-8def-e92f7e7a4aa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF17EVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551002',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 108276,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'SMC Group',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 82 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Allure 5dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551002%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [astonbarclay.gb] INFO: Saving data for 117551002: {'created_time': 1764788585.410533, 'last_price_update_time': 1764788585.410542, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117551002') HTTP/1.1" 204 0
2025-12-03 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee11050>
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/c2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/99463aee-ef7f-4157-9928-8caed52bd452.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e85a823c-df47-404e-9d9c-8d6488f054eb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:03:05 [astonbarclay.gb] INFO: Found listing with ID: 117621861
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621861%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [astonbarclay.gb] INFO: Scrape type for 117621861: 1
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fa028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252Fed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg?w=600 not downloaded yet
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F045d13a0-9784-418b-a242-def546a7010f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/045d13a0-9784-418b-a242-def546a7010f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117707924?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7f5bd0>
2025-12-03 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fcc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/cc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb26dd0>
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba3510>
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg?w=600 saved to cache
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117641049, 'registration': 'RE18MHA', 'account': 'SMC009', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 85 Zetec 5dr', 'mileage': 37631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE18MHA/2025-12-03/image/18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/dc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/a55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/929852c6-4600-4b69-a626-d20cba423309_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d7a4c602-44e0-4237-9c01-21ba57068afc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117641049, 'registration': 'RE18MHA', 'account': 'SMC009', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 85 Zetec 5dr', 'mileage': 37631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE18MHA/2025-12-03/image/18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/dc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/a55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/929852c6-4600-4b69-a626-d20cba423309_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d7a4c602-44e0-4237-9c01-21ba57068afc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b392d1-6766-5da8-a469-f01c4d7ff4d6 with identifier: 117641049
2025-12-03 19:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6 with scrape type 1
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/e1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/a3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:06 [scrapy.extensions.logstats] INFO: Crawled 158 pages (at 50 pages/min), scraped 88 items (at 24 items/min)
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fd3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/d3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea47d10>
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Faaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/aaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea53f90>
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea57ad0>
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:03:07 [astonbarclay.gb] INFO: Found listing with ID: 117621852
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621852%27 HTTP/1.1" 200 None
2025-12-03 19:03:07 [astonbarclay.gb] INFO: Scrape type for 117621852: 1
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg?w=600 not downloaded yet
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252Fbc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/bc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252Fdc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/dc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed5fc90>
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9ef450>
2025-12-03 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fb6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/b6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec48090>
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg?w=600 saved to cache
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fe4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eadfd50>
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed17f90>
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252Fc2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/c2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb1d510>
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F99463aee-ef7f-4157-9928-8caed52bd452.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/99463aee-ef7f-4157-9928-8caed52bd452.jpg?w=600 saved to cache
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca7990>
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe85a823c-df47-404e-9d9c-8d6488f054eb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e85a823c-df47-404e-9d9c-8d6488f054eb.jpg?w=600 saved to cache
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:03:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117719548, 'registration': 'DC65OWK', 'account': 'MOT075', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '1.6 TDI 110 S Line 5dr S Tronic [Nav]', 'mileage': 111102, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2015-12-08', 'fuel': 'Diesel', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC65OWK/2025-12-03/image/e35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/ce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/f6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db34448d-6c1e-490b-87a0-aba9d5ea805b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117719548, 'registration': 'DC65OWK', 'account': 'MOT075', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '1.6 TDI 110 S Line 5dr S Tronic [Nav]', 'mileage': 111102, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2015-12-08', 'fuel': 'Diesel', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC65OWK/2025-12-03/image/e35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/ce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/f6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db34448d-6c1e-490b-87a0-aba9d5ea805b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d8cd854-01cf-579e-ae0c-b030cac4a745 with identifier: 117719548
2025-12-03 19:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8cd854-01cf-579e-ae0c-b030cac4a745 with scrape type 1
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252Fe35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/e35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117707924, 'registration': 'EK20LNP', 'account': 'STE093', 'make': 'BMW', 'model': '2 SERIES COUPE', 'derivative': '218i M Sport 2dr [Nav]', 'mileage': 82553, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-04', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Coupe', 'images': ['https://abimg002.imgix.net/6ffcedd1-464d-4b85-b98e-39f80769d547.jpg?w=600', 'https://abimg002.imgix.net/f5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg?w=600', 'https://abimg002.imgix.net/c604c925-ee85-470e-80af-80ee5d375dfd.jpg?w=600', 'https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c14a7266-2a02-482b-8ef2-9b4e08bff29d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117707924, 'registration': 'EK20LNP', 'account': 'STE093', 'make': 'BMW', 'model': '2 SERIES COUPE', 'derivative': '218i M Sport 2dr [Nav]', 'mileage': 82553, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-04', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Coupe', 'images': ['https://abimg002.imgix.net/6ffcedd1-464d-4b85-b98e-39f80769d547.jpg?w=600', 'https://abimg002.imgix.net/f5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg?w=600', 'https://abimg002.imgix.net/c604c925-ee85-470e-80af-80ee5d375dfd.jpg?w=600', 'https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c14a7266-2a02-482b-8ef2-9b4e08bff29d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc805a-fa25-5106-af44-ee36301a4cc3 with identifier: 117707924
2025-12-03 19:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc805a-fa25-5106-af44-ee36301a4cc3 with scrape type 1
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 03fc805a-fa25-5106-af44-ee36301a4cc3
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F6ffcedd1-464d-4b85-b98e-39f80769d547.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/6ffcedd1-464d-4b85-b98e-39f80769d547.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:03:09 [astonbarclay.gb] INFO: Found listing with ID: 117621842
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621842%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [astonbarclay.gb] INFO: Scrape type for 117621842: 1
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa2ae52af-10fe-4404-a462-6504206846d0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a2ae52af-10fe-4404-a462-6504206846d0.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff1b5d0>
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Fe1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/e1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec3ef50>
2025-12-03 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fa3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/a3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/20695be5-ecf5-485e-a991-740714784946_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg?w=600 not downloaded yet
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec61c50>
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7ece50>
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f863cd0>
2025-12-03 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec62310>
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 117621873
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621873%27 HTTP/1.1" 200 None
2025-12-03 19:03:11 [astonbarclay.gb] INFO: Scrape type for 117621873: 1
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252Fff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fbed26706-0c72-497a-9a74-8e5fd55d7b29.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/bed26706-0c72-497a-9a74-8e5fd55d7b29.jpg?w=600 not downloaded yet
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252Fbbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/bbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252Fa55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/a55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb60b10>
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed20810>
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg?w=600 saved to cache
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/d3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/045d13a0-9784-418b-a242-def546a7010f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc604c925-ee85-470e-80af-80ee5d375dfd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c604c925-ee85-470e-80af-80ee5d375dfd.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f9d70d0>
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f865190>
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f842150>
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/dc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/bc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:12 [astonbarclay.gb] INFO: Found listing with ID: 117623718
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623718%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [astonbarclay.gb] INFO: Scrape type for 117623718: 1
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edeb550>
2025-12-03 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F20695be5-ecf5-485e-a991-740714784946_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/20695be5-ecf5-485e-a991-740714784946_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebdfe10>
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252F7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f786d10>
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252Ff837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba2050>
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fe26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f869250>
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg?w=600 saved to cache
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/e35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/6ffcedd1-464d-4b85-b98e-39f80769d547.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707924?view=catalogue)
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ffe0e9993-75b4-4f42-a068-7e989ed1319f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600 not downloaded yet
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecd1150>
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:14 [astonbarclay.gb] INFO: Found listing with ID: 117624796
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117624796%27 HTTP/1.1" 200 None
2025-12-03 19:03:14 [astonbarclay.gb] INFO: Scrape type for 117624796: 1
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg?w=600 not downloaded yet
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252Fb064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/b064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e16f190>
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9fcbd0>
2025-12-03 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fd3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/d3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba3310>
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F045d13a0-9784-418b-a242-def546a7010f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/045d13a0-9784-418b-a242-def546a7010f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb33810>
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg?w=600 saved to cache
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707924?view=catalogue)
2025-12-03 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f887e90>
2025-12-03 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252Fdc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/dc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede2450>
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252Fbc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/bc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/a55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117702052
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702052%27 HTTP/1.1" 200 None
2025-12-03 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117702052: 1
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F84510207-ea8d-4061-8ec2-a34b1950fe34.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/84510207-ea8d-4061-8ec2-a34b1950fe34.jpg?w=600 not downloaded yet
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F929852c6-4600-4b69-a626-d20cba423309_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/929852c6-4600-4b69-a626-d20cba423309_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7b0350>
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252Fe35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/e35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf0250>
2025-12-03 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F6ffcedd1-464d-4b85-b98e-39f80769d547.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/6ffcedd1-464d-4b85-b98e-39f80769d547.jpg?w=600 saved to cache
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03fc805a-fa25-5106-af44-ee36301a4cc3
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eceb010>
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252Fed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9fcb10>
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c604c925-ee85-470e-80af-80ee5d375dfd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707924?view=catalogue)
2025-12-03 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117672857?view=catalogue)
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb1b050>
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252Fe4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea50890>
2025-12-03 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed23e50>
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg?w=600 saved to cache
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/bbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 117695935
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695935%27 HTTP/1.1" 200 None
2025-12-03 19:03:21 [astonbarclay.gb] INFO: Scrape type for 117695935: 1
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg?w=600 not downloaded yet
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252Fc3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/c3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed6f790>
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea53210>
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg?w=600 saved to cache
2025-12-03 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03fc805a-fa25-5106-af44-ee36301a4cc3
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edc3c10>
2025-12-03 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707924?view=catalogue)
2025-12-03 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252Fce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/ce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d02d0>
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecbc050>
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252Fa55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/a55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d3f10>
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d2450>
2025-12-03 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117699895, 'registration': 'EO71NTF', 'account': 'WBA002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK SPECIAL EDITIONS', 'derivative': '1.3 DiG-T MH Premiere Edition 5dr', 'mileage': 53499, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-10-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO71NTF/2025-12-03/image/21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/efa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/23- 19K, 11/24- 42K', 'remarks': 'VOSA STATES 42K, 53K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4bfa0ac7-ca62-4fc8-bdfc-72c4999fd894.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117699895, 'registration': 'EO71NTF', 'account': 'WBA002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK SPECIAL EDITIONS', 'derivative': '1.3 DiG-T MH Premiere Edition 5dr', 'mileage': 53499, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-10-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO71NTF/2025-12-03/image/21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/efa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/23- 19K, 11/24- 42K', 'remarks': 'VOSA STATES 42K, 53K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4bfa0ac7-ca62-4fc8-bdfc-72c4999fd894.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe21f96-534d-5915-9dec-cecc64a99390 with identifier: 117699895
2025-12-03 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe21f96-534d-5915-9dec-cecc64a99390 with scrape type 1
2025-12-03 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/b064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 116993535
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Scrape type for 116993535: 0
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117495072
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495072%27 HTTP/1.1" 200 None
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117495072: 0
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117662184
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662184%27 HTTP/1.1" 200 None
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117662184: 0
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117662195
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662195%27 HTTP/1.1" 200 None
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117662195: 0
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117021986
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117021986%27 HTTP/1.1" 200 None
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117021986: 0
2025-12-03 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117662175
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662175%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117662175: 0
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117495054
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495054%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117495054: 0
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117495107
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495107%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117495107: 0
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117495085
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495085%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117495085: 0
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117543749
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543749%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117543749: 0
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117708690
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708690%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117708690: 1
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3b382c93-34e7-4544-8183-abe3ef50f5df.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3b382c93-34e7-4544-8183-abe3ef50f5df.jpg?w=600 not downloaded yet
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119ceaa350>
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed01110>
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc604c925-ee85-470e-80af-80ee5d375dfd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c604c925-ee85-470e-80af-80ee5d375dfd.jpg?w=600 saved to cache
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03fc805a-fa25-5106-af44-ee36301a4cc3
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed01e10>
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV71WCX%252F2025-12-03%252Fimage%252F0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f
2025-12-03 19:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c12db2f7-7f23-5d58-8eb2-7f6d91594d8f, skipping ID generation
2025-12-03 19:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f with scrape type 1
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f from tracking dictionaries
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c12db2f7-7f23-5d58-8eb2-7f6d91594d8f sending to next pipeline
2025-12-03 19:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c12db2f7-7f23-5d58-8eb2-7f6d91594d8f, identifier: 117672857
2025-12-03 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/bed26706-0c72-497a-9a74-8e5fd55d7b29.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252Ff6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/f6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c12db2f7-7f23-5d58-8eb2-7f6d91594d8f with identifier: 117672857
2025-12-03 19:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c12db2f7-7f23-5d58-8eb2-7f6d91594d8f with identifier: 117672857
2025-12-03 19:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c12db2f7-7f23-5d58-8eb2-7f6d91594d8f with identifier: 117672857 to the API
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c12db2f7-7f23-5d58-8eb2-7f6d91594d8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AV71WCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117672857',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 27762,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42377,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/5630b963-c45d-45f9-9598-60b6cc012def_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/a3043ad1-e4e1-4a92-8f47-30579a187982_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30553,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/7be8932c-9bb5-4d96-9f3c-3fdf00e94dd6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34874,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e26495c0-0392-4e40-8301-571e7edd947b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57583,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/d3e1ce08-1d0f-40c9-a54f-d787ccd07b03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45085,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/e4edbcbc-b83e-4d7c-bd09-530234543d3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42980,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/730d4107-f889-4619-8511-1c70154d2b5b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12db2f7-7f23-5d58-8eb2-7f6d91594d8f/c12db2f7-7f23-5d58-8eb2-7f6d91594d8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34030,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV71WCX/2025-12-03/image/0c01729e-965c-40b5-96a8-03f77d227649_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-30',
 'seller_name': 'Hedin Automotive',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI Life 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI Life 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672857%27 HTTP/1.1" 200 None
2025-12-03 19:03:25 [astonbarclay.gb] INFO: Saving data for 117672857: {'created_time': 1764788605.442185, 'last_price_update_time': 1764788605.442195, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117672857') HTTP/1.1" 204 0
2025-12-03 19:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee6b110>
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252Fbbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/bbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb27950>
2025-12-03 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117613308, 'registration': 'LV18ZDX', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLE DIESEL ESTATE', 'derivative': 'GLE 250d 4Matic AMG Night Ed Prem + 5dr 9G-Tronic', 'mileage': 43006, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-06-28', 'fuel': 'Diesel', 'motExpiry': '2026-08-25', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/aa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/d9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/bd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/23a16654-34da-41cd-b588-920963105f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/a56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/f4f47898-f650-48bc-98b1-46686044a593_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/75486303-3492-464b-b372-5cdd9c15e760.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117613308, 'registration': 'LV18ZDX', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLE DIESEL ESTATE', 'derivative': 'GLE 250d 4Matic AMG Night Ed Prem + 5dr 9G-Tronic', 'mileage': 43006, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-06-28', 'fuel': 'Diesel', 'motExpiry': '2026-08-25', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/aa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/d9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/bd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/23a16654-34da-41cd-b588-920963105f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/a56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/f4f47898-f650-48bc-98b1-46686044a593_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/75486303-3492-464b-b372-5cdd9c15e760.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f984c8-b200-57f6-aef0-ce4a176efcf9 with identifier: 117613308
2025-12-03 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f984c8-b200-57f6-aef0-ce4a176efcf9 with scrape type 1
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Faa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/aa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/929852c6-4600-4b69-a626-d20cba423309_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117567350
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117567350: 0
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117411447
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411447%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117411447: 0
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117118656
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117118656%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117118656: 0
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117120682
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120682%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117120682: 0
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117273524
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273524%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117273524: 0
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117271012
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271012%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117271012: 0
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117624358
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117624358%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117624358: 1
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg?w=600 not downloaded yet
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edfac90>
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecbde50>
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ffe0e9993-75b4-4f42-a068-7e989ed1319f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600 saved to cache
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03fc805a-fa25-5106-af44-ee36301a4cc3
2025-12-03 19:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03fc805a-fa25-5106-af44-ee36301a4cc3, skipping ID generation
2025-12-03 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc805a-fa25-5106-af44-ee36301a4cc3 with scrape type 1
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 03fc805a-fa25-5106-af44-ee36301a4cc3 from tracking dictionaries
2025-12-03 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03fc805a-fa25-5106-af44-ee36301a4cc3 sending to next pipeline
2025-12-03 19:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 03fc805a-fa25-5106-af44-ee36301a4cc3, identifier: 117707924
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eec2c50>
2025-12-03 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed51f10>
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg?w=600 saved to cache
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8b2750>
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/84510207-ea8d-4061-8ec2-a34b1950fe34.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 03fc805a-fa25-5106-af44-ee36301a4cc3 with identifier: 117707924
2025-12-03 19:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 03fc805a-fa25-5106-af44-ee36301a4cc3 with identifier: 117707924
2025-12-03 19:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 03fc805a-fa25-5106-af44-ee36301a4cc3 with identifier: 117707924 to the API
2025-12-03 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '03fc805a-fa25-5106-af44-ee36301a4cc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK20LNP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707924',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES COUPE',
 'odometer': 82553,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54331,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/6ffcedd1-464d-4b85-b98e-39f80769d547.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54231,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/f5a9245f-c5c9-4da7-b30b-f67bdfb0680e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35844,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/c604c925-ee85-470e-80af-80ee5d375dfd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03fc805a-fa25-5106-af44-ee36301a4cc3/03fc805a-fa25-5106-af44-ee36301a4cc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32238,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/fe0e9993-75b4-4f42-a068-7e989ed1319f.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-27',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 2 SERIES COUPE 218i M Sport 2dr [Nav]',
 'transmission': 'manual',
 'trim': '218i M Sport 2dr [Nav]',
 'vin': None,
 'year': 2020}
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707924%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Saving data for 117707924: {'created_time': 1764788608.130046, 'last_price_update_time': 1764788608.130059, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117707924') HTTP/1.1" 204 0
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f76c990>
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea27710>
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252Fb064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/b064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/c3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641049?view=catalogue)
2025-12-03 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a2ae52af-10fe-4404-a462-6504206846d0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117727318?view=catalogue)
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117253368
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253368%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117253368: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117214479
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214479%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117214479: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117140269
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140269%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117140269: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117219838
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219838%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117219838: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117359464
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117359464%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117359464: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117327029
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327029%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117327029: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117362589
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362589%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117362589: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117399206
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399206%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117399206: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117353225
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117353225%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117353225: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117242472
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242472%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117242472: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117269658
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269658%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117269658: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117194162
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117194162%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117194162: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117260567
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260567%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117260567: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117372557
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372557%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117372557: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117242944
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242944%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117242944: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117178030
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178030%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117178030: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117230187
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117230187%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117230187: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117399373
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399373%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117399373: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117444495
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444495%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117444495: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117208422
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117208422%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117208422: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117398180
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117398180%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117398180: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117119906
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117119906%27 HTTP/1.1" 200 None
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117119906: 0
2025-12-03 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117120453
2025-12-03 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Scrape type for 117120453: 0
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Found listing with ID: 117140308
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140308%27 HTTP/1.1" 200 None
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Scrape type for 117140308: 0
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Found listing with ID: 115926008
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115926008%27 HTTP/1.1" 200 None
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Scrape type for 115926008: 0
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Found listing with ID: 117310319
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310319%27 HTTP/1.1" 200 None
2025-12-03 19:03:29 [astonbarclay.gb] INFO: Scrape type for 117310319: 1
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4626b177-ee4e-4994-af45-23ff6c585f87.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4626b177-ee4e-4994-af45-23ff6c585f87.jpg?w=600 not downloaded yet
2025-12-03 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f769450>
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf11d0>
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252Fff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf2e90>
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fbed26706-0c72-497a-9a74-8e5fd55d7b29.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/bed26706-0c72-497a-9a74-8e5fd55d7b29.jpg?w=600 saved to cache
2025-12-03 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb14c10>
2025-12-03 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg?w=600 saved to cache
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/ce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Fd9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/d9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e5910>
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F929852c6-4600-4b69-a626-d20cba423309_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/929852c6-4600-4b69-a626-d20cba423309_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee6bf90>
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3b382c93-34e7-4544-8183-abe3ef50f5df.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:30 [astonbarclay.gb] INFO: Found listing with ID: 117402212
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402212%27 HTTP/1.1" 200 None
2025-12-03 19:03:30 [astonbarclay.gb] INFO: Scrape type for 117402212: 1
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff59df7e8-9611-41e0-83ea-00a41393c9a2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f59df7e8-9611-41e0-83ea-00a41393c9a2.jpg?w=600 not downloaded yet
2025-12-03 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed422d0>
2025-12-03 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed644d0>
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F84510207-ea8d-4061-8ec2-a34b1950fe34.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/84510207-ea8d-4061-8ec2-a34b1950fe34.jpg?w=600 saved to cache
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/aa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252Fefa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/efa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec4a210>
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252Fc3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/c3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea58cd0>
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRE18MHA%252F2025-12-03%252Fimage%252F66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6
2025-12-03 19:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46b392d1-6766-5da8-a469-f01c4d7ff4d6, skipping ID generation
2025-12-03 19:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6 with scrape type 1
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46b392d1-6766-5da8-a469-f01c4d7ff4d6 from tracking dictionaries
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46b392d1-6766-5da8-a469-f01c4d7ff4d6 sending to next pipeline
2025-12-03 19:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46b392d1-6766-5da8-a469-f01c4d7ff4d6, identifier: 117641049
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e518f50>
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa2ae52af-10fe-4404-a462-6504206846d0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a2ae52af-10fe-4404-a462-6504206846d0.jpg?w=600 saved to cache
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7690d0>
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSH16AZU%252F2025-12-03%252Fimage%252F676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0b97f82-19b4-545b-9168-4ab99e82faf7
2025-12-03 19:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0b97f82-19b4-545b-9168-4ab99e82faf7, skipping ID generation
2025-12-03 19:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0b97f82-19b4-545b-9168-4ab99e82faf7 with scrape type 1
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a0b97f82-19b4-545b-9168-4ab99e82faf7 from tracking dictionaries
2025-12-03 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0b97f82-19b4-545b-9168-4ab99e82faf7 sending to next pipeline
2025-12-03 19:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a0b97f82-19b4-545b-9168-4ab99e82faf7, identifier: 117727318
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117624796, 'registration': 'KF68PLV', 'account': 'STE093', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '30 TDI 116 S Line 5dr S Tronic', 'mileage': 113806, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-12-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KF68PLV/2025-12-03/image/baca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/cfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/f4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/c3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f9657de-b294-4111-8a72-9aa682c39db2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117624796, 'registration': 'KF68PLV', 'account': 'STE093', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '30 TDI 116 S Line 5dr S Tronic', 'mileage': 113806, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-12-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KF68PLV/2025-12-03/image/baca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/cfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/f4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/c3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f9657de-b294-4111-8a72-9aa682c39db2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94106acc-7406-594d-9ab0-82c8bfa49099 with identifier: 117624796
2025-12-03 19:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94106acc-7406-594d-9ab0-82c8bfa49099 with scrape type 1
2025-12-03 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Fbaca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/baca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/f6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623603?view=catalogue)
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117598315
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598315%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117598315: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 116806926
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 116806926: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 116258586
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 116258586: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117570357
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117570357: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 116378959
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116378959%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 116378959: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 116188432
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116188432%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 116188432: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117591412
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117591412%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117591412: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117538127
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538127%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117538127: 0
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117707470
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707470%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117707470: 1
2025-12-03 19:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46b392d1-6766-5da8-a469-f01c4d7ff4d6 with identifier: 117641049
2025-12-03 19:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46b392d1-6766-5da8-a469-f01c4d7ff4d6 with identifier: 117641049
2025-12-03 19:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46b392d1-6766-5da8-a469-f01c4d7ff4d6 with identifier: 117641049 to the API
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '46b392d1-6766-5da8-a469-f01c4d7ff4d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RE18MHA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641049',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KA+ HATCHBACK',
 'odometer': 37631,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29917,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/18b58816-12de-496b-bf99-9d949625a9fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26794,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/dc1f76c5-55e1-4f40-9d8d-290c72032df5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/53dd2f68-aa0d-431f-a4e3-1bf2b14e2d24_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26896,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/a55e6531-b03a-447d-9332-31afef22edcf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45565,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/14f03963-3173-4a9c-ae0e-d6720f3fe1a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33999,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/07d9f8b6-aae0-4ed7-ba8a-4d1b0967a3dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46985,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/929852c6-4600-4b69-a626-d20cba423309_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b392d1-6766-5da8-a469-f01c4d7ff4d6/46b392d1-6766-5da8-a469-f01c4d7ff4d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29097,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RE18MHA/2025-12-03/image/66e25b17-8e59-497b-aec8-91246342ddcb_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-27',
 'seller_name': 'SMC Group',
 'title': 'FORD KA+ HATCHBACK 1.2 85 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.2 85 Zetec 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641049%27 HTTP/1.1" 200 None
2025-12-03 19:03:33 [astonbarclay.gb] INFO: Saving data for 117641049: {'created_time': 1764788613.554029, 'last_price_update_time': 1764788613.554042, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117641049') HTTP/1.1" 204 0
2025-12-03 19:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a0b97f82-19b4-545b-9168-4ab99e82faf7 with identifier: 117727318
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BROWN HTTP/1.1" 200 None
2025-12-03 19:03:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a0b97f82-19b4-545b-9168-4ab99e82faf7 with identifier: 117727318
2025-12-03 19:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a0b97f82-19b4-545b-9168-4ab99e82faf7 with identifier: 117727318 to the API
2025-12-03 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BROWN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a0b97f82-19b4-545b-9168-4ab99e82faf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SH16AZU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117727318',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA DIESEL HATCHBACK',
 'odometer': 31080,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30286,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/23400bf6-2766-48ea-b5ac-ac7abaf5ecdb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29305,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/c2604fe4-f424-4890-ac03-a24055d7b8c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30112,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/8469383e-aa9e-4960-98c3-42d3b216e481_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29494,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/5498492b-4d8c-4e7b-a1af-2c696f401f90_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50621,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/29c6ad0c-d245-45f9-a523-4158ccae149c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94517,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/7f6c389d-15b4-4381-99a2-7ec619424fb0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89616,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/676436c1-d2e9-42cc-93ca-9a39296d56d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50489,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/bbdbab3d-3658-462c-91b6-5757796aa0ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b97f82-19b4-545b-9168-4ab99e82faf7/a0b97f82-19b4-545b-9168-4ab99e82faf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36991,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SH16AZU/2025-12-03/image/0e5549f8-3bcc-458b-9590-70f441962ffb_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-20',
 'seller_name': 'SMC Group',
 'title': 'VAUXHALL INSIGNIA DIESEL HATCHBACK 1.6 CDTi Elite Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 CDTi Elite Nav 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117727318%27 HTTP/1.1" 200 None
2025-12-03 19:03:34 [astonbarclay.gb] INFO: Saving data for 117727318: {'created_time': 1764788614.183219, 'last_price_update_time': 1764788614.183233, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117727318') HTTP/1.1" 204 0
2025-12-03 19:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc5f50>
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee02e50>
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg?w=600 saved to cache
2025-12-03 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee01750>
2025-12-03 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252Fce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/ce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DC65OWK/2025-12-03/image/83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117719548?view=catalogue)
2025-12-03 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Fbd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/bd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f79c550>
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_13.jpg HTTP/1.1" 201 0
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3b382c93-34e7-4544-8183-abe3ef50f5df.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3b382c93-34e7-4544-8183-abe3ef50f5df.jpg?w=600 saved to cache
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f79c6d0>
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4626b177-ee4e-4994-af45-23ff6c585f87.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:35 [astonbarclay.gb] INFO: Found listing with ID: 117573762
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573762%27 HTTP/1.1" 200 None
2025-12-03 19:03:35 [astonbarclay.gb] INFO: Scrape type for 117573762: 1
2025-12-03 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee96ed0>
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Faa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/aa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f822dd0>
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/d9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F23a16654-34da-41cd-b588-920963105f8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/23a16654-34da-41cd-b588-920963105f8e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eec0a90>
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252Ff6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/f6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea57b90>
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_14.jpg HTTP/1.1" 201 0
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg?w=600 saved to cache
2025-12-03 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec31490>
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAE68RZS%252F2025-12-03%252Fimage%252F6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606
2025-12-03 19:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60e813d4-fe3f-5867-8e7b-bd5d8894a606, skipping ID generation
2025-12-03 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606 with scrape type 1
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 60e813d4-fe3f-5867-8e7b-bd5d8894a606 from tracking dictionaries
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60e813d4-fe3f-5867-8e7b-bd5d8894a606 sending to next pipeline
2025-12-03 19:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60e813d4-fe3f-5867-8e7b-bd5d8894a606, identifier: 117623603
2025-12-03 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686613?view=catalogue)
2025-12-03 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f59df7e8-9611-41e0-83ea-00a41393c9a2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117646620?view=catalogue)
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Found listing with ID: 117581450
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581450%27 HTTP/1.1" 200 None
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Scrape type for 117581450: 0
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Found listing with ID: 117217494
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217494%27 HTTP/1.1" 200 None
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Scrape type for 117217494: 0
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Found listing with ID: 117580703
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580703%27 HTTP/1.1" 200 None
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Scrape type for 117580703: 0
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Found listing with ID: 115302250
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Scrape type for 115302250: 0
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Found listing with ID: 117213726
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213726%27 HTTP/1.1" 200 None
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Scrape type for 117213726: 1
2025-12-03 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60e813d4-fe3f-5867-8e7b-bd5d8894a606 with identifier: 117623603
2025-12-03 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60e813d4-fe3f-5867-8e7b-bd5d8894a606 with identifier: 117623603
2025-12-03 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60e813d4-fe3f-5867-8e7b-bd5d8894a606 with identifier: 117623603 to the API
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '60e813d4-fe3f-5867-8e7b-bd5d8894a606',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AE68RZS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623603',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK SPECIAL EDITION',
 'odometer': 23564,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39702,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/028b8336-e6b9-4781-b9f8-9bf9a6245c21_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40229,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/045d13a0-9784-418b-a242-def546a7010f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40757,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/bc0c973e-011f-4912-a69a-9bbe14a467e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39548,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/573e3109-a6bb-4198-93e5-7ff8093a6c04_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44819,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/9da02168-bc3b-463a-b285-508a5759ae9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31211,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/58ea9241-4070-42a8-8344-443ceb8aba3e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34990,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/b064eac6-6dc1-447e-a9fb-181c2c5ce75f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43204,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/006f8834-c555-499e-8880-a10081d6ee46_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52977,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/c3e3f75b-6dae-43fd-8e6c-a4699bda9ced_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46487,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/78b1d240-4033-4522-a538-d5da9a222f1e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e813d4-fe3f-5867-8e7b-bd5d8894a606/60e813d4-fe3f-5867-8e7b-bd5d8894a606_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49653,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AE68RZS/2025-12-03/image/6ebb95b5-53a3-4663-9576-1e20086e0153_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-07',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 1 SERIES HATCHBACK SPECIAL EDITION 118i [1.5] M Sport Shadow Ed '
          '5dr Step Auto',
 'transmission': 'automatic',
 'trim': '118i [1.5] M Sport Shadow Ed 5dr Step Auto',
 'vin': None,
 'year': 2018}
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623603%27 HTTP/1.1" 200 None
2025-12-03 19:03:37 [astonbarclay.gb] INFO: Saving data for 117623603: {'created_time': 1764788617.584955, 'last_price_update_time': 1764788617.584967, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623603') HTTP/1.1" 204 0
2025-12-03 19:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea552d0>
2025-12-03 19:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDC65OWK%252F2025-12-03%252Fimage%252F83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DC65OWK/2025-12-03/image/83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d8cd854-01cf-579e-ae0c-b030cac4a745
2025-12-03 19:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d8cd854-01cf-579e-ae0c-b030cac4a745, skipping ID generation
2025-12-03 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8cd854-01cf-579e-ae0c-b030cac4a745 with scrape type 1
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0d8cd854-01cf-579e-ae0c-b030cac4a745 from tracking dictionaries
2025-12-03 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d8cd854-01cf-579e-ae0c-b030cac4a745 sending to next pipeline
2025-12-03 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d8cd854-01cf-579e-ae0c-b030cac4a745, identifier: 117719548
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed01f10>
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1d5d0>
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117695935, 'registration': 'ET19OVH', 'account': 'WBA002', 'make': 'FIAT', 'model': '500X HATCHBACK', 'derivative': '1.0 Cross Plus 5dr', 'mileage': 89978, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-08-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET19OVH/2025-12-03/image/a9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/cc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/e47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/d9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/20- 9K, 03/??- 19K, 11/21- 31K, 06/25- 86K', 'remarks': 'VOSA STATES 43K, 59K, 74K, 89K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/81a3ed7c-5d02-4726-b38b-c7308c122ca9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117695935, 'registration': 'ET19OVH', 'account': 'WBA002', 'make': 'FIAT', 'model': '500X HATCHBACK', 'derivative': '1.0 Cross Plus 5dr', 'mileage': 89978, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-08-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET19OVH/2025-12-03/image/a9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/cc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/e47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/d9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/20- 9K, 03/??- 19K, 11/21- 31K, 06/25- 86K', 'remarks': 'VOSA STATES 43K, 59K, 74K, 89K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/81a3ed7c-5d02-4726-b38b-c7308c122ca9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0996638b-5f37-5acd-9186-f75da5582b20 with identifier: 117695935
2025-12-03 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0996638b-5f37-5acd-9186-f75da5582b20 with scrape type 1
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fa9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/a9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/baca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/efa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117708690?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d8cd854-01cf-579e-ae0c-b030cac4a745 with identifier: 117719548
2025-12-03 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d8cd854-01cf-579e-ae0c-b030cac4a745 with identifier: 117719548
2025-12-03 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178800 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178800
2025-12-03 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0d8cd854-01cf-579e-ae0c-b030cac4a745 spider: astonbarclay.gb
2025-12-03 19:03:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0d8cd854-01cf-579e-ae0c-b030cac4a745 due to rule: high_mileage_for_country.json, error: 178800 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178800
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0d8cd854-01cf-579e-ae0c-b030cac4a745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DC65OWK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117719548',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 DIESEL SPORTBACK',
 'odometer': 111102,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26101,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/e35d1381-20c6-46f2-80cf-821b3a91e8ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28406,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/194b4cc2-325c-410c-a825-916e37455b74_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29054,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/8b5a5a9b-50c3-4c7d-a2b7-6f8b29d1a0e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27637,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/2e319d16-b9b1-4095-80c9-8e68e1a31dba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38415,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/089e52ad-447a-4a8a-bd05-bb595dfe9c00_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45165,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/294d5c7b-e2db-4954-aa09-094d39dbaf89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47139,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/ce30b24f-539e-4b87-b767-ba1cb437296f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38373,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/f6fab587-65b8-4344-9b7e-62289730e310_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8cd854-01cf-579e-ae0c-b030cac4a745/0d8cd854-01cf-579e-ae0c-b030cac4a745_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41380,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DC65OWK/2025-12-03/image/83d13f54-bd6b-4976-bf27-877fe8395277_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-08',
 'seller_name': 'MotoNovo Finance',
 'title': 'AUDI A3 DIESEL SPORTBACK 1.6 TDI 110 S Line 5dr S Tronic [Nav]',
 'transmission': 'automatic',
 'trim': '1.6 TDI 110 S Line 5dr S Tronic [Nav]',
 'vin': None,
 'year': 2015}
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117719548%27 HTTP/1.1" 200 None
2025-12-03 19:03:38 [astonbarclay.gb] INFO: Saving data for 117719548: {'created_time': 1764788618.859697, 'last_price_update_time': 1764788618.859706, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117719548') HTTP/1.1" 204 0
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea34c90>
2025-12-03 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_15.jpg HTTP/1.1" 201 0
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4626b177-ee4e-4994-af45-23ff6c585f87.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4626b177-ee4e-4994-af45-23ff6c585f87.jpg?w=600 saved to cache
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623718, 'registration': 'LJ19WHB', 'account': 'STE093', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '120i [2.0] M Sport 3dr [Nav/Servotronic] Step Auto', 'mileage': 67000, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-02-07', 'doors': 3, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/b2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/8220c218-9c99-480c-812a-92da897c645b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/e4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/cb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/39f362a8-4fd7-4ab0-93bc-ed78265e72c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623718, 'registration': 'LJ19WHB', 'account': 'STE093', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '120i [2.0] M Sport 3dr [Nav/Servotronic] Step Auto', 'mileage': 67000, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-02-07', 'doors': 3, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/b2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/8220c218-9c99-480c-812a-92da897c645b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/e4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/cb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/39f362a8-4fd7-4ab0-93bc-ed78265e72c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59580356-6ce9-56c0-9850-4ca232a91aa9 with identifier: 117623718
2025-12-03 19:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59580356-6ce9-56c0-9850-4ca232a91aa9 with scrape type 1
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fb2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/b2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Found listing with ID: 117642361
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642361%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Scrape type for 117642361: 0
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Found listing with ID: 117651285
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651285%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Scrape type for 117651285: 0
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Found listing with ID: 117434122
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117434122%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [astonbarclay.gb] INFO: Scrape type for 117434122: 1
2025-12-03 19:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117624358?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaef710>
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Fd9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/d9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee43e90>
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/bd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Fa56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/a56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee80c90>
2025-12-03 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF19RKJ%252F2025-12-03%252Fimage%252F5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe
2025-12-03 19:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bebe1a9-a055-56aa-ab66-495c354ae9fe, skipping ID generation
2025-12-03 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe with scrape type 1
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4bebe1a9-a055-56aa-ab66-495c354ae9fe from tracking dictionaries
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bebe1a9-a055-56aa-ab66-495c354ae9fe sending to next pipeline
2025-12-03 19:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4bebe1a9-a055-56aa-ab66-495c354ae9fe, identifier: 117686613
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee2c710>
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_16.jpg HTTP/1.1" 201 0
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff59df7e8-9611-41e0-83ea-00a41393c9a2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f59df7e8-9611-41e0-83ea-00a41393c9a2.jpg?w=600 saved to cache
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2
2025-12-03 19:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1296ac9e-04ac-5736-add0-9dd6a567e1d2, skipping ID generation
2025-12-03 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2 with scrape type 1
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1296ac9e-04ac-5736-add0-9dd6a567e1d2 from tracking dictionaries
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1296ac9e-04ac-5736-add0-9dd6a567e1d2 sending to next pipeline
2025-12-03 19:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1296ac9e-04ac-5736-add0-9dd6a567e1d2, identifier: 117646620
2025-12-03 19:03:40 [astonbarclay.gb] INFO: Found listing with ID: 116752111
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116752111%27 HTTP/1.1" 200 None
2025-12-03 19:03:40 [astonbarclay.gb] INFO: Scrape type for 116752111: 0
2025-12-03 19:03:40 [astonbarclay.gb] INFO: Found listing with ID: 116013920
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116013920%27 HTTP/1.1" 200 None
2025-12-03 19:03:40 [astonbarclay.gb] INFO: Scrape type for 116013920: 0
2025-12-03 19:03:40 [astonbarclay.gb] INFO: Found listing with ID: 117429220
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429220%27 HTTP/1.1" 200 None
2025-12-03 19:03:40 [astonbarclay.gb] INFO: Scrape type for 117429220: 1
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fcc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/cc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4bebe1a9-a055-56aa-ab66-495c354ae9fe with identifier: 117686613
2025-12-03 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4bebe1a9-a055-56aa-ab66-495c354ae9fe with identifier: 117686613
2025-12-03 19:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4bebe1a9-a055-56aa-ab66-495c354ae9fe with identifier: 117686613 to the API
2025-12-03 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4bebe1a9-a055-56aa-ab66-495c354ae9fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CF19RKJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686613',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'ZS HATCHBACK',
 'odometer': 38180,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24547,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/4ef52aa5-c65b-4170-9ea1-91df55c007af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27530,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/8a7e088b-61c3-45c3-86ec-649f82f64879_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25485,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9622fe81-7c31-4888-8731-d89c2aecb4a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25987,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/13e16327-71df-416e-94f9-d1c212f5b3a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47207,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/20695be5-ecf5-485e-a991-740714784946_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76173,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ed03d573-ec50-42a4-a520-880f864c6d25_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80956,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/9d8adaa5-9bb2-42d0-8896-97e423bfa1ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51653,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/5b69c33b-4c42-43df-8355-64a6e9bf6dc4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bebe1a9-a055-56aa-ab66-495c354ae9fe/4bebe1a9-a055-56aa-ab66-495c354ae9fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37224,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF19RKJ/2025-12-03/image/ff5fce79-a4ca-4577-9816-a33868f91f26_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': 'UKCGR - Premium',
 'title': 'MG MOTOR UK ZS HATCHBACK 1.5 VTi-TECH Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Exclusive 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686613%27 HTTP/1.1" 200 None
2025-12-03 19:03:41 [astonbarclay.gb] INFO: Saving data for 117686613: {'created_time': 1764788621.128662, 'last_price_update_time': 1764788621.128672, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117686613') HTTP/1.1" 204 0
2025-12-03 19:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1296ac9e-04ac-5736-add0-9dd6a567e1d2 with identifier: 117646620
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-03 19:03:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1296ac9e-04ac-5736-add0-9dd6a567e1d2 with identifier: 117646620
2025-12-03 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner tepee' containing 'partner'
2025-12-03 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1296ac9e-04ac-5736-add0-9dd6a567e1d2 spider: astonbarclay.gb
2025-12-03 19:03:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1296ac9e-04ac-5736-add0-9dd6a567e1d2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner tepee' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1296ac9e-04ac-5736-add0-9dd6a567e1d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SF19AXX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117646620',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': 'PARTNER TEPEE',
 'odometer': 32350,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80584,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/2e093ad1-95c6-4691-a2e0-81b8f014bf56.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76473,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/90419ec4-94e8-4dc7-89b0-50909603e1ae.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50870,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/99463aee-ef7f-4157-9928-8caed52bd452.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88765,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/8c14f54d-4258-401b-a753-ac10b66ee6a0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87567,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/1fd1a546-50de-4d6d-917e-9d9000aa0820.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80964,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/5a55c9ae-04e2-4c95-a825-8f490cdda3aa.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81591,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/011f2541-8dd1-4405-b22d-68b71ce1aeaf.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84520,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/a2ae52af-10fe-4404-a462-6504206846d0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47854,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/bed26706-0c72-497a-9a74-8e5fd55d7b29.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43539,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/b24aaa9d-1fe6-4889-94c9-6bbec814e10c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85550,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/8af277da-c1e1-4e3e-85bc-93c2aef8c9a0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46805,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/84510207-ea8d-4061-8ec2-a34b1950fe34.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54633,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/0d12f813-b202-44a0-9277-8ccc25a37cdf.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53038,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/3b382c93-34e7-4544-8183-abe3ef50f5df.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62879,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/1acd9ba8-cfc0-4bea-af1c-e4acd5cafbf1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64351,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/4626b177-ee4e-4994-af45-23ff6c585f87.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296ac9e-04ac-5736-add0-9dd6a567e1d2/1296ac9e-04ac-5736-add0-9dd6a567e1d2_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49069,
             'Height': 449,
             'OriginUrl': 'https://abimg002.imgix.net/f59df7e8-9611-41e0-83ea-00a41393c9a2.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': 'Vantage Motor Group',
 'title': 'PEUGEOT PARTNER TEPEE 1.6 BlueHDi 100 Active 5dr ETG',
 'transmission': 'automatic',
 'trim': '1.6 BlueHDi 100 Active 5dr ETG',
 'vin': None,
 'year': 2019}
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117646620%27 HTTP/1.1" 200 None
2025-12-03 19:03:41 [astonbarclay.gb] INFO: Saving data for 117646620: {'created_time': 1764788621.649757, 'last_price_update_time': 1764788621.649766, 'auction_closing_time': 1765285200.0}
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117646620') HTTP/1.1" 204 0
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee6d610>
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f894810>
2025-12-03 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Fbaca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/baca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f772750>
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252Fefa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/efa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117708690, 'registration': 'WF17WYC', 'account': 'ARN181', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL COUPE', 'derivative': 'E220d AMG Line Premium 2dr 9G-Tronic', 'mileage': 125122, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-30', 'doors': 2, 'engineSize': 1950, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 82k, 89k, 102k, 114k, 123k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117708690, 'registration': 'WF17WYC', 'account': 'ARN181', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL COUPE', 'derivative': 'E220d AMG Line Premium 2dr 9G-Tronic', 'mileage': 125122, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 168}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-30', 'doors': 2, 'engineSize': 1950, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 82k, 89k, 102k, 114k, 123k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660fae44-a3c5-5025-833d-a580ccdfc63e with identifier: 117708690
2025-12-03 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660fae44-a3c5-5025-833d-a580ccdfc63e with scrape type 1
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 660fae44-a3c5-5025-833d-a580ccdfc63e
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 660fae44-a3c5-5025-833d-a580ccdfc63e
2025-12-03 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 660fae44-a3c5-5025-833d-a580ccdfc63e, identifier: 117708690
2025-12-03 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/23a16654-34da-41cd-b588-920963105f8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Ff4f47898-f650-48bc-98b1-46686044a593_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/f4f47898-f650-48bc-98b1-46686044a593_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 660fae44-a3c5-5025-833d-a580ccdfc63e with identifier: 117708690
2025-12-03 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 660fae44-a3c5-5025-833d-a580ccdfc63e with identifier: 117708690
2025-12-03 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'mercedes-benz e class diesel coupe e220d amg line premium 2dr 9g-tronic', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'e class diesel coupe', 'transmission': 'automatic', 'engine': '1.9l', 'fuel_type': 'diesel', 'odometer': 125122, 'odometer_reading_unit': 'mi', 'registration_date': '2017-05-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708690', 'expiration_date': '2025-12-11t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': 'e220d amg line premium 2dr 9g-tronic', 'license_plate': 'wf17wyc', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 2, 'c_o_2_emission_value': 119, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '660fae44-a3c5-5025-833d-a580ccdfc63e', 'current_year_diff': 8, 'age_in_months': 102, 'make_model': 'mercedes-benz e class diesel coupe', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 201363}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 2,
     'emission_standard': 'euro 6',
     'engine': '1.9l',
     'expiration_date': '2025-12-11t10:00:00z',
     'fuel_type': 'diesel',
     'id': '660fae44-a3c5-5025-833d-a580ccdfc63e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wf17wyc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708690',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz e class diesel coupe',
     'model': 'e class diesel coupe',
     'odometer': 125122,
     'odometer_in_km': 201363,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-05-31',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'arnold clark',
     'title': 'mercedes-benz e class diesel coupe e220d amg line premium '
              '2dr 9g-tronic',
     'transmission': 'automatic',
     'trim': 'e220d amg line premium 2dr 9g-tronic',
     'vin': None,
     'year': 2017}
2025-12-03 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 660fae44-a3c5-5025-833d-a580ccdfc63e spider: astonbarclay.gb
2025-12-03 19:03:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 660fae44-a3c5-5025-833d-a580ccdfc63e due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'mercedes-benz e class diesel coupe e220d amg line premium 2dr 9g-tronic', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'e class diesel coupe', 'transmission': 'automatic', 'engine': '1.9l', 'fuel_type': 'diesel', 'odometer': 125122, 'odometer_reading_unit': 'mi', 'registration_date': '2017-05-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708690', 'expiration_date': '2025-12-11t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': 'e220d amg line premium 2dr 9g-tronic', 'license_plate': 'wf17wyc', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 2, 'c_o_2_emission_value': 119, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '660fae44-a3c5-5025-833d-a580ccdfc63e', 'current_year_diff': 8, 'age_in_months': 102, 'make_model': 'mercedes-benz e class diesel coupe', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 201363}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 2,
     'emission_standard': 'euro 6',
     'engine': '1.9l',
     'expiration_date': '2025-12-11t10:00:00z',
     'fuel_type': 'diesel',
     'id': '660fae44-a3c5-5025-833d-a580ccdfc63e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wf17wyc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708690',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz e class diesel coupe',
     'model': 'e class diesel coupe',
     'odometer': 125122,
     'odometer_in_km': 201363,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-05-31',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'arnold clark',
     'title': 'mercedes-benz e class diesel coupe e220d amg line premium '
              '2dr 9g-tronic',
     'transmission': 'automatic',
     'trim': 'e220d amg line premium 2dr 9g-tronic',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '660fae44-a3c5-5025-833d-a580ccdfc63e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF17WYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708690',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL COUPE',
 'odometer': 125122,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'Arnold Clark',
 'title': 'MERCEDES-BENZ E CLASS DIESEL COUPE E220d AMG Line Premium 2dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d AMG Line Premium 2dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708690%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Saving data for 117708690: {'created_time': 1764788622.874916, 'last_price_update_time': 1764788622.874925, 'auction_closing_time': 1765447200.0}
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117708690') HTTP/1.1" 204 0
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117310319, 'registration': 'LM25YTG', 'account': 'MOT070', 'make': 'KIA', 'model': 'NIRO EV ESTATE', 'derivative': '150kW 2 Nav 65kWh 5dr Auto', 'mileage': 4514, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-14', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7d980de3-fb1f-47b8-a771-2399a87c2061.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117310319, 'registration': 'LM25YTG', 'account': 'MOT070', 'make': 'KIA', 'model': 'NIRO EV ESTATE', 'derivative': '150kW 2 Nav 65kWh 5dr Auto', 'mileage': 4514, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-14', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7d980de3-fb1f-47b8-a771-2399a87c2061.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f with identifier: 117310319
2025-12-03 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f with scrape type 1
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117621873, 'registration': 'MM67ZSN', 'account': 'ALL023', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '1.7 CRDi ISG 2 5dr', 'mileage': 83155, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-29', 'doors': 5, 'engineSize': 1685, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/e40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/a4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba07c27f-2af7-4e51-b831-865ff28ec1a3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117621873, 'registration': 'MM67ZSN', 'account': 'ALL023', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '1.7 CRDi ISG 2 5dr', 'mileage': 83155, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-29', 'doors': 5, 'engineSize': 1685, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/e40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/a4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600', 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba07c27f-2af7-4e51-b831-865ff28ec1a3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67632d15-8b25-59ec-88f5-39d0870d2a5f with identifier: 117621873
2025-12-03 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67632d15-8b25-59ec-88f5-39d0870d2a5f with scrape type 1
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252Fe40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/e40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117702052, 'registration': 'BP17MFJ', 'account': 'WBA002', 'make': 'MINI', 'model': 'HATCHBACK DIESEL', 'derivative': '1.5 One D 3dr', 'mileage': 78096, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 3, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/a63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/b973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/19- 25K, 04/24- 52K', 'remarks': 'VOSA STATES 35K, 43K, 57K, 76K,  SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 89, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca27958f-87c0-46bb-8459-166338091d20.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117702052, 'registration': 'BP17MFJ', 'account': 'WBA002', 'make': 'MINI', 'model': 'HATCHBACK DIESEL', 'derivative': '1.5 One D 3dr', 'mileage': 78096, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 3, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/a63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/b973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/19- 25K, 04/24- 52K', 'remarks': 'VOSA STATES 35K, 43K, 57K, 76K,  SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 89, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca27958f-87c0-46bb-8459-166338091d20.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8dba93-5e7a-5e46-b5ef-4fb2295aa27a with identifier: 117702052
2025-12-03 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a with scrape type 1
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Ff32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117624358, 'registration': 'DF23JDU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 20562, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117624358, 'registration': 'DF23JDU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 20562, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7776649b-af2e-5021-b2d4-2a2b139d7bad with identifier: 117624358
2025-12-03 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7776649b-af2e-5021-b2d4-2a2b139d7bad with scrape type 1
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7776649b-af2e-5021-b2d4-2a2b139d7bad
2025-12-03 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7776649b-af2e-5021-b2d4-2a2b139d7bad
2025-12-03 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7776649b-af2e-5021-b2d4-2a2b139d7bad, identifier: 117624358
2025-12-03 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/a9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 116645477
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-12-03 19:03:43 [astonbarclay.gb] INFO: Scrape type for 116645477: 0
2025-12-03 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 117462219
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117462219%27 HTTP/1.1" 200 None
2025-12-03 19:03:43 [astonbarclay.gb] INFO: Scrape type for 117462219: 1
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7776649b-af2e-5021-b2d4-2a2b139d7bad with identifier: 117624358
2025-12-03 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7776649b-af2e-5021-b2d4-2a2b139d7bad with identifier: 117624358
2025-12-03 19:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7776649b-af2e-5021-b2d4-2a2b139d7bad with identifier: 117624358 to the API
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277776649b-af2e-5021-b2d4-2a2b139d7bad%27 HTTP/1.1" 200 None
2025-12-03 19:03:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7776649b-af2e-5021-b2d4-2a2b139d7bad: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:03:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117624358?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7776649b-af2e-5021-b2d4-2a2b139d7bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23JDU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117624358',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 20562,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117624358%27 HTTP/1.1" 200 None
2025-12-03 19:03:43 [astonbarclay.gb] INFO: Saving data for 117624358: {'created_time': 1764788623.411156, 'last_price_update_time': 1764788623.411166, 'auction_closing_time': 1765532700.0}
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117624358') HTTP/1.1" 204 0
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb429d0>
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Fbd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/bd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed74850>
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebf3fd0>
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/b2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Fcfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/cfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fa7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117703363?view=catalogue)
2025-12-03 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117686371?view=catalogue)
2025-12-03 19:03:44 [astonbarclay.gb] INFO: Found listing with ID: 117381413
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381413%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [astonbarclay.gb] INFO: Scrape type for 117381413: 1
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb8d050>
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F23a16654-34da-41cd-b588-920963105f8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/23a16654-34da-41cd-b588-920963105f8e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8ac110>
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb8f850>
2025-12-03 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252Fef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed67d10>
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fa9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/a9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117707470, 'registration': 'LG72VNT', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 28603, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Electric', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/24 14K', 'remarks': 'NO V5 FORMER KEEPERS UNKOWN - OUTSTANDING RECALL - VOSA STATES, 27K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b19d7687-d379-4ac2-afbd-8824e1f40381.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117707470, 'registration': 'LG72VNT', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 28603, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Electric', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/24 14K', 'remarks': 'NO V5 FORMER KEEPERS UNKOWN - OUTSTANDING RECALL - VOSA STATES, 27K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b19d7687-d379-4ac2-afbd-8824e1f40381.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e5bef35-148d-549e-99fc-2fa26477e347 with identifier: 117707470
2025-12-03 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5bef35-148d-549e-99fc-2fa26477e347 with scrape type 1
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117402212, 'registration': 'LV75WFO', 'account': 'MOT070', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B4P Plus Black Edition 5dr Auto', 'mileage': 1319, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-10-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV75WFO/2025-11-25/image/ca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/eefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f3ea96e-9e4c-46e1-81e8-0093365024ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117402212, 'registration': 'LV75WFO', 'account': 'MOT070', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B4P Plus Black Edition 5dr Auto', 'mileage': 1319, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-10-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV75WFO/2025-11-25/image/ca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/eefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f3ea96e-9e4c-46e1-81e8-0093365024ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33a2d32-5fd9-5bad-94bb-1e27b34a722a with identifier: 117402212
2025-12-03 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a with scrape type 1
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252Fca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/ca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/a56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/cc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:45 [astonbarclay.gb] INFO: Found listing with ID: 117358574
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117358574%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [astonbarclay.gb] INFO: Scrape type for 117358574: 1
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f793850>
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fb2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/b2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d5590>
2025-12-03 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff481d0>
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee2a590>
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/e40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Ff4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/f4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252Fa4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/a4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed7acd0>
2025-12-03 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV69OVZ%252F2025-12-03%252Fimage%252Fa028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b
2025-12-03 19:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b, skipping ID generation
2025-12-03 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b with scrape type 1
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b from tracking dictionaries
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b sending to next pipeline
2025-12-03 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b, identifier: 117703363
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd4110>
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL16YKB%252F2025-12-03%252Fimage%252F39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79bdaf28-e84c-51b6-ab89-00076b814301
2025-12-03 19:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79bdaf28-e84c-51b6-ab89-00076b814301, skipping ID generation
2025-12-03 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bdaf28-e84c-51b6-ab89-00076b814301 with scrape type 1
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 79bdaf28-e84c-51b6-ab89-00076b814301 from tracking dictionaries
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79bdaf28-e84c-51b6-ab89-00076b814301 sending to next pipeline
2025-12-03 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 79bdaf28-e84c-51b6-ab89-00076b814301, identifier: 117686371
2025-12-03 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:03:47 [astonbarclay.gb] INFO: Found listing with ID: 117547260
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547260%27 HTTP/1.1" 200 None
2025-12-03 19:03:47 [astonbarclay.gb] INFO: Scrape type for 117547260: 1
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b with identifier: 117703363
2025-12-03 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b with identifier: 117703363
2025-12-03 19:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b with identifier: 117703363 to the API
2025-12-03 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FV69OVZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117703363',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA HATCHBACK SPECIAL EDS',
 'odometer': 52973,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26520,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/29cad1a1-afc8-4605-922e-b10f9f0e688a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25696,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/ec113739-a404-4615-b6ad-b6a223c8ac60_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23604,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/63a6eb0c-0ba6-4418-b6d8-86e6b149e569_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22832,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/cc385220-38c6-4ab6-8b8a-5d12b6e4ddd2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48780,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/b6876d22-b951-4822-9aa0-25a3ce64ea85_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85729,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/183c5915-861b-4c9f-8a62-a1ba49e337a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68018,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ca6291f-f02a-47fe-b957-48bbbda5f515_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56272,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/7ce41a4a-7c31-49dc-b2f9-ddb4fd76d255_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b/2ede9f76-a9fb-5f3f-90ba-5f38e2068b6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36741,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FV69OVZ/2025-12-03/image/a028de61-ce81-4a7f-8b21-58977e734716_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': 'UKCGR - Premium',
 'title': 'VAUXHALL ASTRA HATCHBACK SPECIAL EDS 1.4T 16V 150 Griffin 5dr Auto '
          '[Start Stop]',
 'transmission': 'automatic',
 'trim': '1.4T 16V 150 Griffin 5dr Auto [Start Stop]',
 'vin': None,
 'year': 2019}
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117703363%27 HTTP/1.1" 200 None
2025-12-03 19:03:48 [astonbarclay.gb] INFO: Saving data for 117703363: {'created_time': 1764788628.66229, 'last_price_update_time': 1764788628.6623, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117703363') HTTP/1.1" 204 0
2025-12-03 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 79bdaf28-e84c-51b6-ab89-00076b814301 with identifier: 117686371
2025-12-03 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 79bdaf28-e84c-51b6-ab89-00076b814301 with identifier: 117686371
2025-12-03 19:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 79bdaf28-e84c-51b6-ab89-00076b814301 with identifier: 117686371 to the API
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '79bdaf28-e84c-51b6-ab89-00076b814301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL16YKB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686371',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL COUPE',
 'odometer': 70689,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32154,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f3e2f9f5-cab1-4624-9776-9c7f6cfdc56f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30618,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/abd12e79-0dcd-459d-b031-a713a94d155a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29370,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/94e00d06-f200-45fd-a209-e7f0af216b8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28556,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/0a3c5915-1213-40f3-b1b2-0f81be19c332_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42414,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/aaea6146-1e67-4d79-9d68-97ad8f80d9b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45422,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/e1e9e49d-df91-429d-bfb2-a1d79379dc5f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48817,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/836c758d-146f-4b51-a012-2fbf99afbaca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52982,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/f837becb-91ac-429f-b187-a22a2620cdbb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bdaf28-e84c-51b6-ab89-00076b814301/79bdaf28-e84c-51b6-ab89-00076b814301_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42928,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL16YKB/2025-12-03/image/39a45e5d-cf4b-495d-8563-5ce9075e6b32_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-25',
 'seller_name': 'UKCGR - Premium',
 'title': 'MERCEDES-BENZ C CLASS DIESEL COUPE C250d AMG Line Premium Plus 2dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'C250d AMG Line Premium Plus 2dr Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686371%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [astonbarclay.gb] INFO: Saving data for 117686371: {'created_time': 1764788629.059465, 'last_price_update_time': 1764788629.059474, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117686371') HTTP/1.1" 204 0
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec5d350>
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/f4f47898-f650-48bc-98b1-46686044a593_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Fc3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/c3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117621842?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117621852?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9b0d0>
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Fa56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/a56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff68d10>
2025-12-03 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb4ee50>
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fcc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/cc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:03:50 [astonbarclay.gb] INFO: Found listing with ID: 116986413
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116986413%27 HTTP/1.1" 200 None
2025-12-03 19:03:50 [astonbarclay.gb] INFO: Scrape type for 116986413: 1
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fe47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/e47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9e6510>
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252Fe40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/e40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca3950>
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea62190>
2025-12-03 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Ff32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea61450>
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/ca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F8220c218-9c99-480c-812a-92da897c645b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/8220c218-9c99-480c-812a-92da897c645b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fe8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9ef310>
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573762, 'registration': 'AV73YHP', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 25054, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/e5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/ab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/c7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 10K - 08/25 21K', 'remarks': 'NO V5 FORMER KEEPERS UNNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6c856c9d-300e-4450-8a2f-cf308fd6138b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573762, 'registration': 'AV73YHP', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 25054, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/e5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/ab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/c7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 10K - 08/25 21K', 'remarks': 'NO V5 FORMER KEEPERS UNNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6c856c9d-300e-4450-8a2f-cf308fd6138b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a21cd41-6cdd-5963-990c-6a2836ad0aec with identifier: 117573762
2025-12-03 19:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec with scrape type 1
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Found listing with ID: 116798984
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Scrape type for 116798984: 0
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Found listing with ID: 117086159
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117086159%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Scrape type for 117086159: 0
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Found listing with ID: 117394487
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394487%27 HTTP/1.1" 200 None
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Scrape type for 117394487: 0
2025-12-03 19:03:51 [astonbarclay.gb] INFO: Found listing with ID: 117395964
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117395964%27 HTTP/1.1" 200 None
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Scrape type for 117395964: 0
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Found listing with ID: 117406754
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406754%27 HTTP/1.1" 200 None
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Scrape type for 117406754: 0
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Found listing with ID: 117110106
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117110106%27 HTTP/1.1" 200 None
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Scrape type for 117110106: 1
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8b3090>
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252Ff4f47898-f650-48bc-98b1-46686044a593_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/f4f47898-f650-48bc-98b1-46686044a593_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea5b050>
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebce210>
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117621842, 'registration': 'EK67KTG', 'account': 'ALL023', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.2 One 5dr', 'mileage': 70310, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-26', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e6d375a5-e6eb-4db6-a4d4-35073d85310e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117621842, 'registration': 'EK67KTG', 'account': 'ALL023', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.2 One 5dr', 'mileage': 70310, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-26', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e6d375a5-e6eb-4db6-a4d4-35073d85310e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3 with identifier: 117621842
2025-12-03 19:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3 with scrape type 1
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3
2025-12-03 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3
2025-12-03 19:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3, identifier: 117621842
2025-12-03 19:03:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117621852, 'registration': 'YH20DFY', 'account': 'ALL023', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i Sport 4dr Step Auto', 'mileage': 28603, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-11', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ca100c3-ddb4-4fdb-b80d-bf3d6be936c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117621852, 'registration': 'YH20DFY', 'account': 'ALL023', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i Sport 4dr Step Auto', 'mileage': 28603, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-11', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ca100c3-ddb4-4fdb-b80d-bf3d6be936c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8ffa7a1-27e0-53ff-96cd-596406bc510e with identifier: 117621852
2025-12-03 19:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ffa7a1-27e0-53ff-96cd-596406bc510e with scrape type 1
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a8ffa7a1-27e0-53ff-96cd-596406bc510e
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a8ffa7a1-27e0-53ff-96cd-596406bc510e
2025-12-03 19:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a8ffa7a1-27e0-53ff-96cd-596406bc510e, identifier: 117621852
2025-12-03 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fd1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252Feefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/eefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3 with identifier: 117621842
2025-12-03 19:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3 with identifier: 117621842
2025-12-03 19:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3 with identifier: 117621842 to the API
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278d340224-f2fc-5dd6-b8aa-a4e2b6baede3%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8d340224-f2fc-5dd6-b8aa-a4e2b6baede3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:03:52 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117621842?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8d340224-f2fc-5dd6-b8aa-a4e2b6baede3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK67KTG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117621842',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 70310,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-30',
 'seller_name': 'SMC GROUP',
 'title': 'MINI HATCHBACK 1.2 One 5dr',
 'transmission': 'manual',
 'trim': '1.2 One 5dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621842%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [astonbarclay.gb] INFO: Saving data for 117621842: {'created_time': 1764788633.526223, 'last_price_update_time': 1764788633.526232, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117621842') HTTP/1.1" 204 0
2025-12-03 19:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a8ffa7a1-27e0-53ff-96cd-596406bc510e with identifier: 117621852
2025-12-03 19:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a8ffa7a1-27e0-53ff-96cd-596406bc510e with identifier: 117621852
2025-12-03 19:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a8ffa7a1-27e0-53ff-96cd-596406bc510e with identifier: 117621852 to the API
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a8ffa7a1-27e0-53ff-96cd-596406bc510e%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a8ffa7a1-27e0-53ff-96cd-596406bc510e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:03:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117621852?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a8ffa7a1-27e0-53ff-96cd-596406bc510e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YH20DFY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117621852',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 28603,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': 'SMC GROUP',
 'title': 'BMW 3 SERIES SALOON 320i Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '320i Sport 4dr Step Auto',
 'vin': None,
 'year': 2020}
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621852%27 HTTP/1.1" 200 None
2025-12-03 19:03:53 [astonbarclay.gb] INFO: Saving data for 117621852: {'created_time': 1764788633.96522, 'last_price_update_time': 1764788633.965232, 'auction_closing_time': 1765360800.0}
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117621852') HTTP/1.1" 204 0
2025-12-03 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edf9a50>
2025-12-03 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed6f810>
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117213726, 'registration': 'LY74XJT', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta 5dr Auto', 'mileage': 7781, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY74XJT/2025-11-17/image/81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/047e5903-84b8-485b-8485-a1005247762a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/cbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/f6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6b1252bb-5179-4e93-8ab0-f6c12897c016.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117213726, 'registration': 'LY74XJT', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta 5dr Auto', 'mileage': 7781, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY74XJT/2025-11-17/image/81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/047e5903-84b8-485b-8485-a1005247762a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/cbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/f6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6b1252bb-5179-4e93-8ab0-f6c12897c016.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a90106bc-5ec2-578c-9c3b-aa0782b46d85 with identifier: 117213726
2025-12-03 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90106bc-5ec2-578c-9c3b-aa0782b46d85 with scrape type 1
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/a4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117360572
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117360572%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117360572: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117080670
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117080670%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117080670: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117416921
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117416921: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117415829
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415829%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117415829: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117185008
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185008%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117185008: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117599419
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599419%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117599419: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 114344014
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 114344014: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117537741
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537741%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117537741: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 115990741
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115990741%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 115990741: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 114700069
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114700069%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 114700069: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 114698400
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114698400%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 114698400: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117547683
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117547683: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 116643961
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116643961%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 116643961: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117023136
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023136%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117023136: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 116500039
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 116500039: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117239774
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239774%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117239774: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117492820
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492820%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117492820: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117460295
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460295%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117460295: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117087842
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117087842: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117625956
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625956%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117625956: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117601597
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601597%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117601597: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 116412555
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 116412555: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 116557093
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 116557093: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 116420630
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116420630%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 116420630: 0
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 117503025
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117503025%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [astonbarclay.gb] INFO: Scrape type for 117503025: 1
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebce5d0>
2025-12-03 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea33590>
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252Fca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/ca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1e350>
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fe4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/e4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252Fc5b614da-d633-4468-8595-31409c690023_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Ff4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fb2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252Fc1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252Fe5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/e5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F047e5903-84b8-485b-8485-a1005247762a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/047e5903-84b8-485b-8485-a1005247762a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8ca850>
2025-12-03 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede9390>
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117462219, 'registration': 'AU25NDC', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.6 E-TECH full hybrid 145 Evolution 5dr Auto', 'mileage': 7739, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-18', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AU25NDC/2025-11-25/image/66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/cc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/e0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/c2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/a4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/561204cb-7065-423d-a6bb-548d5dc878cd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117462219, 'registration': 'AU25NDC', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.6 E-TECH full hybrid 145 Evolution 5dr Auto', 'mileage': 7739, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-18', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AU25NDC/2025-11-25/image/66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/cc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/e0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/c2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/a4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/561204cb-7065-423d-a6bb-548d5dc878cd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0663ed4b-bc9e-5a57-ab52-220e092def5b with identifier: 117462219
2025-12-03 19:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0663ed4b-bc9e-5a57-ab52-220e092def5b with scrape type 1
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Found listing with ID: 117550264
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Scrape type for 117550264: 0
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Found listing with ID: 116504950
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Scrape type for 116504950: 0
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Found listing with ID: 117599669
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599669%27 HTTP/1.1" 200 None
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Scrape type for 117599669: 0
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Found listing with ID: 117711420
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117711420%27 HTTP/1.1" 200 None
2025-12-03 19:03:56 [astonbarclay.gb] INFO: Scrape type for 117711420: 1
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fd9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/d9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea4c790>
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed18d50>
2025-12-03 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede0190>
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/e47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fcb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/cb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fa63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/a63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Fcbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/cbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fcc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/cc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee30a90>
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea97510>
2025-12-03 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea320d0>
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252Fa4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/a4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117381413, 'registration': 'PK75XRV', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 200 AMG Line Executive 5dr Tip Auto', 'mileage': 4073, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PK75XRV/2025-11-21/image/1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/d4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/c66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/af004963-6f2b-4497-a6c6-be4b9b0924ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117381413, 'registration': 'PK75XRV', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 200 AMG Line Executive 5dr Tip Auto', 'mileage': 4073, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PK75XRV/2025-11-21/image/1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/d4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/c66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/af004963-6f2b-4497-a6c6-be4b9b0924ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c6b631-296d-5779-bf52-9c024062c917 with identifier: 117381413
2025-12-03 19:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c6b631-296d-5779-bf52-9c024062c917 with scrape type 1
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 117633313
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633313%27 HTTP/1.1" 200 None
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Scrape type for 117633313: 0
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 116269848
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116269848%27 HTTP/1.1" 200 None
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Scrape type for 116269848: 0
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 117733516
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117733516%27 HTTP/1.1" 200 None
2025-12-03 19:03:58 [astonbarclay.gb] INFO: Scrape type for 117733516: 1
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebe89d0>
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edb5cd0>
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fd1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fb973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/b973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Ff6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/f6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fdf41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec32590>
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee65410>
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea631d0>
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg?w=600 saved to cache
2025-12-03 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/eefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:03:59 [astonbarclay.gb] INFO: Found listing with ID: 117706537
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117706537%27 HTTP/1.1" 200 None
2025-12-03 19:03:59 [astonbarclay.gb] INFO: Scrape type for 117706537: 1
2025-12-03 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed46290>
2025-12-03 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed46f90>
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fe47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/e47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f804a90>
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fcaed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fe0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/e0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f89e990>
2025-12-03 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fe8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/e5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/047e5903-84b8-485b-8485-a1005247762a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:01 [astonbarclay.gb] INFO: Found listing with ID: 117735065
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735065%27 HTTP/1.1" 200 None
2025-12-03 19:04:01 [astonbarclay.gb] INFO: Scrape type for 117735065: 1
2025-12-03 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117110106?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c8190>
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec5ae90>
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6f3d10>
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7fde50>
2025-12-03 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/cc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/cbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/d9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Fd034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fdf1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea55ed0>
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f85f090>
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252Feefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/eefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee05690>
2025-12-03 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:03 [astonbarclay.gb] INFO: Found listing with ID: 117605936
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605936%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [astonbarclay.gb] INFO: Scrape type for 117605936: 0
2025-12-03 19:04:03 [astonbarclay.gb] INFO: Found listing with ID: 117705726
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117705726%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [astonbarclay.gb] INFO: Scrape type for 117705726: 1
2025-12-03 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb4f3d0>
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fd33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252Fab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/ab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252Fd4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/d4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebd1950>
2025-12-03 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d5510>
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252Fe5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/e5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebd2a50>
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F047e5903-84b8-485b-8485-a1005247762a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/047e5903-84b8-485b-8485-a1005247762a_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117110106, 'registration': 'EA75CXP', 'account': 'MOT070', 'make': 'HONDA', 'model': 'JAZZ HATCHBACK', 'derivative': '1.5 i-MMD Hybrid Advance 5dr eCVT', 'mileage': 991, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-10-11', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117110106, 'registration': 'EA75CXP', 'account': 'MOT070', 'make': 'HONDA', 'model': 'JAZZ HATCHBACK', 'derivative': '1.5 i-MMD Hybrid Advance 5dr eCVT', 'mileage': 991, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-10-11', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3bae997-b59b-501e-8d85-00781ea8a8ce with identifier: 117110106
2025-12-03 19:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3bae997-b59b-501e-8d85-00781ea8a8ce with scrape type 1
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3bae997-b59b-501e-8d85-00781ea8a8ce
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA75CXP%252F2025-11-13%252Fimage%252F1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/f6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 116265155
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116265155%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Scrape type for 116265155: 0
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 117122763
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117122763%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Scrape type for 117122763: 0
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 117407486
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407486%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Scrape type for 117407486: 0
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 117550785
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Scrape type for 117550785: 0
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 116872991
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Scrape type for 116872991: 0
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 117522663
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522663%27 HTTP/1.1" 200 None
2025-12-03 19:04:04 [astonbarclay.gb] INFO: Scrape type for 117522663: 2
2025-12-03 19:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec2e2d0>
2025-12-03 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec49e90>
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fcc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/cc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee671d0>
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Fcbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/cbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7eb910>
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252Fd9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/d9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/e0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252Fc66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/c66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eab79d0>
2025-12-03 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117503025, 'registration': 'AO25DZP', 'account': 'MOT071', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 250e AMG Line Executive 4dr Tip Auto', 'mileage': 15453, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-05-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AO25DZP/2025-11-27/image/372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/b0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/d0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/ecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/cab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 17, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5f5ac7a7-021b-46a5-8002-788f6f01f0b8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117503025, 'registration': 'AO25DZP', 'account': 'MOT071', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 250e AMG Line Executive 4dr Tip Auto', 'mileage': 15453, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-05-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AO25DZP/2025-11-27/image/372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/b0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/d0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/ecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/cab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 17, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5f5ac7a7-021b-46a5-8002-788f6f01f0b8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2132145-db70-5a27-9757-1de434f8a896 with identifier: 117503025
2025-12-03 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2132145-db70-5a27-9757-1de434f8a896 with scrape type 1
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:06 [scrapy.extensions.logstats] INFO: Crawled 178 pages (at 20 pages/min), scraped 99 items (at 11 items/min)
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Found listing with ID: 117268826
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Scrape type for 117268826: 0
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Found listing with ID: 117407792
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407792%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Scrape type for 117407792: 0
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Found listing with ID: 117269311
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269311%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Scrape type for 117269311: 0
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Found listing with ID: 117709907
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117709907%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Scrape type for 117709907: 1
2025-12-03 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1f050>
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7390d0>
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547260, 'registration': 'WM71RRU', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 35797, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-02-23', 'fuel': 'Petrol', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/e5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/23 11K - 01/24 27K - 01/25 34K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 35K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13e01cc8-81ee-4b81-bd78-3ba26b057565.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547260, 'registration': 'WM71RRU', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 35797, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-02-23', 'fuel': 'Petrol', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/e5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/23 11K - 01/24 27K - 01/25 34K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 35K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13e01cc8-81ee-4b81-bd78-3ba26b057565.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8327be07-600f-559f-84ad-913783c741c0 with identifier: 117547260
2025-12-03 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8327be07-600f-559f-84ad-913783c741c0 with scrape type 1
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252Fb2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252Fc7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/c7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Fd06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fb0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/b0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edb2310>
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fdf41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec4aa10>
2025-12-03 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Ff6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/f6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf9ad0>
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 117421105
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421105%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Scrape type for 117421105: 0
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 117407455
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407455%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Scrape type for 117407455: 0
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 117316133
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316133%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Scrape type for 117316133: 0
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 117316150
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316150%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Scrape type for 117316150: 0
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 117563859
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563859%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Scrape type for 117563859: 0
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 115457692
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [astonbarclay.gb] INFO: Scrape type for 115457692: 2
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec3c2d0>
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba3510>
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fe0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/e0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f77e090>
2025-12-03 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116986413, 'registration': 'LV24XBM', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.5 TSI SE L 5dr', 'mileage': 24001, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-05-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV24XBM/2025-11-25/image/2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/448365c5-7640-438d-880a-d21bd11ef1d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116986413, 'registration': 'LV24XBM', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.5 TSI SE L 5dr', 'mileage': 24001, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-05-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV24XBM/2025-11-25/image/2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/448365c5-7640-438d-880a-d21bd11ef1d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72087037-5acb-5d9c-ba1b-1f15139a8e3c with identifier: 116986413
2025-12-03 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c with scrape type 1
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/d4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117110106?view=catalogue)
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fc2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/c2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fd0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/d0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecbc750>
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6f1050>
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117733516, 'registration': 'EY69HKZ', 'account': 'WBA001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR DIESEL ESTATE', 'derivative': '2.0 D180 S 5dr Auto', 'mileage': 26207, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-09-13', 'fuel': 'Diesel', 'motExpiry': '2026-02-27', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/dbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/21- 18K', 'remarks': 'VOSA STATES 19K, 24K, 25K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76e3459a-5521-4c06-9540-63bece35ee31.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117733516, 'registration': 'EY69HKZ', 'account': 'WBA001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR DIESEL ESTATE', 'derivative': '2.0 D180 S 5dr Auto', 'mileage': 26207, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-09-13', 'fuel': 'Diesel', 'motExpiry': '2026-02-27', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/dbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/21- 18K', 'remarks': 'VOSA STATES 19K, 24K, 25K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76e3459a-5521-4c06-9540-63bece35ee31.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30189d55-f6e9-5985-b93c-569f800edb33 with identifier: 117733516
2025-12-03 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30189d55-f6e9-5985-b93c-569f800edb33 with scrape type 1
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fc5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/ab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Found listing with ID: 117106625
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117106625%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Scrape type for 117106625: 0
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Found listing with ID: 116937928
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116937928%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Scrape type for 116937928: 0
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Found listing with ID: 116997220
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997220%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Scrape type for 116997220: 0
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Found listing with ID: 117605946
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605946%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Scrape type for 117605946: 0
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Found listing with ID: 117732515
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117732515%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [astonbarclay.gb] INFO: Scrape type for 117732515: 1
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252Fb9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff51610>
2025-12-03 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1af50>
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Fd034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1a690>
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fdf1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/c66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fa4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/a4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/ecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec39f90>
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8a2e50>
2025-12-03 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9c850>
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:11 [astonbarclay.gb] INFO: Found listing with ID: 117691830
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117691830%27 HTTP/1.1" 200 None
2025-12-03 19:04:11 [astonbarclay.gb] INFO: Scrape type for 117691830: 0
2025-12-03 19:04:11 [astonbarclay.gb] INFO: Found listing with ID: 117732998
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117732998%27 HTTP/1.1" 200 None
2025-12-03 19:04:11 [astonbarclay.gb] INFO: Scrape type for 117732998: 1
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd7690>
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252Fd4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/d4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75cbd0>
2025-12-03 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3bae997-b59b-501e-8d85-00781ea8a8ce/c3bae997-b59b-501e-8d85-00781ea8a8ce_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA75CXP%252F2025-11-13%252Fimage%252F1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3bae997-b59b-501e-8d85-00781ea8a8ce
2025-12-03 19:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3bae997-b59b-501e-8d85-00781ea8a8ce, skipping ID generation
2025-12-03 19:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3bae997-b59b-501e-8d85-00781ea8a8ce with scrape type 1
2025-12-03 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c3bae997-b59b-501e-8d85-00781ea8a8ce from tracking dictionaries
2025-12-03 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3bae997-b59b-501e-8d85-00781ea8a8ce sending to next pipeline
2025-12-03 19:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c3bae997-b59b-501e-8d85-00781ea8a8ce, identifier: 117110106
2025-12-03 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/b0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c3bae997-b59b-501e-8d85-00781ea8a8ce with identifier: 117110106
2025-12-03 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c3bae997-b59b-501e-8d85-00781ea8a8ce with identifier: 117110106
2025-12-03 19:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c3bae997-b59b-501e-8d85-00781ea8a8ce with identifier: 117110106 to the API
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'c3bae997-b59b-501e-8d85-00781ea8a8ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA75CXP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117110106',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'JAZZ HATCHBACK',
 'odometer': 991,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bae997-b59b-501e-8d85-00781ea8a8ce/c3bae997-b59b-501e-8d85-00781ea8a8ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25474,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA75CXP/2025-11-13/image/1b064268-941e-4a6d-9b21-efdf88d10c59_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-10-11',
 'seller_name': 'Motability Operations',
 'title': 'HONDA JAZZ HATCHBACK 1.5 i-MMD Hybrid Advance 5dr eCVT',
 'transmission': 'automatic',
 'trim': '1.5 i-MMD Hybrid Advance 5dr eCVT',
 'vin': None,
 'year': 2025}
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117110106%27 HTTP/1.1" 200 None
2025-12-03 19:04:12 [astonbarclay.gb] INFO: Saving data for 117110106: {'created_time': 1764788652.758029, 'last_price_update_time': 1764788652.758041, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117110106') HTTP/1.1" 204 0
2025-12-03 19:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8ba550>
2025-12-03 19:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb04350>
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb05d90>
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252Fab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/ab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117706537, 'registration': 'LS18GXE', 'account': 'WBA001', 'make': 'BMW', 'model': '4 SERIES GRAN DIESEL COUPE', 'derivative': '435d xDrive M Sport 5dr Auto [Professional Media]', 'mileage': 97857, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-22', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/e7975616-795d-4513-9112-c2e8811f6396_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/d1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/c3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/25- 91K', 'remarks': 'VOSA STATES 52K, 67K, 79K, 91K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53e2838e-240a-48d6-99e5-8988eb529c29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117706537, 'registration': 'LS18GXE', 'account': 'WBA001', 'make': 'BMW', 'model': '4 SERIES GRAN DIESEL COUPE', 'derivative': '435d xDrive M Sport 5dr Auto [Professional Media]', 'mileage': 97857, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-22', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/e7975616-795d-4513-9112-c2e8811f6396_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/d1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/c3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/25- 91K', 'remarks': 'VOSA STATES 52K, 67K, 79K, 91K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53e2838e-240a-48d6-99e5-8988eb529c29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf31a292-abe9-5a47-8e3b-1d1792b63e24 with identifier: 117706537
2025-12-03 19:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf31a292-abe9-5a47-8e3b-1d1792b63e24 with scrape type 1
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:13 [astonbarclay.gb] INFO: Found listing with ID: 116988307
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-12-03 19:04:13 [astonbarclay.gb] INFO: Scrape type for 116988307: 0
2025-12-03 19:04:13 [astonbarclay.gb] INFO: Found listing with ID: 117713732
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117713732%27 HTTP/1.1" 200 None
2025-12-03 19:04:13 [astonbarclay.gb] INFO: Scrape type for 117713732: 1
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8da350>
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed21dd0>
2025-12-03 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252Fc66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/c66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea4f810>
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/d0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fafea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fc7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec52190>
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252Fb2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f758b10>
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252F0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117735065, 'registration': 'BD66MYJ', 'account': 'WBA001', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX4h 5dr Auto', 'mileage': 98432, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-19', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/dcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/b0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/a590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'former keepers unknown, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 42, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fab36d8b-41c5-4475-8dc4-8657eb7f425d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117735065, 'registration': 'BD66MYJ', 'account': 'WBA001', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX4h 5dr Auto', 'mileage': 98432, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-19', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/dcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/b0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/a590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'former keepers unknown, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 42, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fab36d8b-41c5-4475-8dc4-8657eb7f425d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abdc061-4429-5f01-a90a-e2a427c381f9 with identifier: 117735065
2025-12-03 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abdc061-4429-5f01-a90a-e2a427c381f9 with scrape type 1
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/c2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252Fe5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/e5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f750810>
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fb0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/b0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8aaf90>
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8abfd0>
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/ecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee82810>
2025-12-03 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee32d10>
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117705726, 'registration': 'BJ66XBY', 'account': 'WBA001', 'make': 'PORSCHE', 'model': 'MACAN DIESEL ESTATE', 'derivative': 'S Diesel 5dr PDK', 'mileage': 90439, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-02-12', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/f936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/c14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/b19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/e683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/a74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/ab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25- 64K', 'remarks': 'VOSA STATES 45K, 46K, 64K, 85K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '7', 'v5': True, 'v5details': 'Here', 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ade80df-b843-4d60-ad75-df8c713a0e06.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117705726, 'registration': 'BJ66XBY', 'account': 'WBA001', 'make': 'PORSCHE', 'model': 'MACAN DIESEL ESTATE', 'derivative': 'S Diesel 5dr PDK', 'mileage': 90439, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-02-12', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/f936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/c14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/b19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/e683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/a74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/ab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25- 64K', 'remarks': 'VOSA STATES 45K, 46K, 64K, 85K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '7', 'v5': True, 'v5details': 'Here', 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ade80df-b843-4d60-ad75-df8c713a0e06.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70851189-346f-5565-8de4-84862d542f11 with identifier: 117705726
2025-12-03 19:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70851189-346f-5565-8de4-84862d542f11 with scrape type 1
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Ff936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/f936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381413?view=catalogue)
2025-12-03 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/a4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119caff750>
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fd0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/d0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f78a550>
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8b9d10>
2025-12-03 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fc5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fcab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/cab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fc14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/c14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f847c10>
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edacdd0>
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fc2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/c2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec3b510>
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252Fb9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115457692?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb5b90>
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/ecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f77c750>
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fdbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/dbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252Fdcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/dcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb16ed0>
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK75XRV%252F2025-11-21%252Fimage%252F61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82c6b631-296d-5779-bf52-9c024062c917
2025-12-03 19:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82c6b631-296d-5779-bf52-9c024062c917, skipping ID generation
2025-12-03 19:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c6b631-296d-5779-bf52-9c024062c917 with scrape type 1
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 82c6b631-296d-5779-bf52-9c024062c917 from tracking dictionaries
2025-12-03 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82c6b631-296d-5779-bf52-9c024062c917 sending to next pipeline
2025-12-03 19:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 82c6b631-296d-5779-bf52-9c024062c917, identifier: 117381413
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f789490>
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252Fa4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/a4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8ac590>
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/e5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117522663?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 82c6b631-296d-5779-bf52-9c024062c917 with identifier: 117381413
2025-12-03 19:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 82c6b631-296d-5779-bf52-9c024062c917 with identifier: 117381413
2025-12-03 19:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 82c6b631-296d-5779-bf52-9c024062c917 with identifier: 117381413 to the API
2025-12-03 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '82c6b631-296d-5779-bf52-9c024062c917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PK75XRV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117381413',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 4073,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/1826603c-d170-480b-8bc1-6dda9457163f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41055,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/5bfa904f-0b3f-4cfa-a2ce-1a614ea67939_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39084,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/630b2d9f-e946-4974-a206-edcddd07de25_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41499,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/0cda4073-3f35-41ef-91b0-86c27853c575_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38384,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/d4d2c1b3-7c57-4ed8-b4a1-1a643ffbdb99_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51322,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/c66e7198-db05-4bb9-b7fa-e83b677aba76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40620,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/01e6fe0f-9ea0-4775-b45d-3384b837c9b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39877,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/111e2369-f5ac-4752-ae1f-f5185f7614dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c6b631-296d-5779-bf52-9c024062c917/82c6b631-296d-5779-bf52-9c024062c917_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29201,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PK75XRV/2025-11-21/image/61e06b3b-3459-4d09-a541-a7f241931d01_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-30',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE CLA 200 AMG Line Executive 5dr Tip '
          'Auto',
 'transmission': 'automatic',
 'trim': 'CLA 200 AMG Line Executive 5dr Tip Auto',
 'vin': None,
 'year': 2025}
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381413%27 HTTP/1.1" 200 None
2025-12-03 19:04:20 [astonbarclay.gb] INFO: Saving data for 117381413: {'created_time': 1764788660.211003, 'last_price_update_time': 1764788660.211014, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117381413') HTTP/1.1" 204 0
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb250d0>
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e4590>
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eec1350>
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/f936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252Fb0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/b0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117732998?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75a510>
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f73bb10>
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9ec90>
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f793890>
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115457692, 'registration': 'SH70XHZ', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE Dynamic 5dr Auto', 'mileage': 58856, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-11-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d9430313-a41a-4543-9e38-bb174b8d8c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3d6c4928-b0dd-41c5-a7d6-17da830727d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/afab8c24-aaba-47ee-a54d-3361df10d9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/8b2b895a-acae-4376-99c6-99c321587142_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d46f2c47-217e-44aa-b227-81261cfcd068_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3676b677-aad7-4bb2-bd41-cd462779a256_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/f9a7c435-439a-4052-a22e-a9f6f0bdd4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/84ead4fd-c425-4ac3-9f96-4083538f5e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3bd85656-5e16-4949-9800-c2c495b30acd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/22-15K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 24K, 28K, 53K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 75, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/301af9a9-f42c-416a-ba0f-e59c32faa699.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115457692, 'registration': 'SH70XHZ', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE Dynamic 5dr Auto', 'mileage': 58856, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-11-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d9430313-a41a-4543-9e38-bb174b8d8c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3d6c4928-b0dd-41c5-a7d6-17da830727d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/afab8c24-aaba-47ee-a54d-3361df10d9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/8b2b895a-acae-4376-99c6-99c321587142_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d46f2c47-217e-44aa-b227-81261cfcd068_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3676b677-aad7-4bb2-bd41-cd462779a256_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/f9a7c435-439a-4052-a22e-a9f6f0bdd4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/84ead4fd-c425-4ac3-9f96-4083538f5e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3bd85656-5e16-4949-9800-c2c495b30acd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/22-15K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 24K, 28K, 53K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 75, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/301af9a9-f42c-416a-ba0f-e59c32faa699.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-12-03 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c771c7-041e-5d53-ad17-7dea3f7e3abd with scrape type 2
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c771c7-041e-5d53-ad17-7dea3f7e3abd with scrape type 2
2025-12-03 19:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 18c771c7-041e-5d53-ad17-7dea3f7e3abd, identifier: 115457692
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252Fcaf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-12-03 19:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-12-03 19:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692 to the API
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115457692?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 75,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '18c771c7-041e-5d53-ad17-7dea3f7e3abd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SH70XHZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115457692',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT ESTATE',
 'odometer': 58856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': 'Mann Island Finance',
 'title': 'LAND ROVER RANGE ROVER SPORT ESTATE 2.0 P400e HSE Dynamic 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P400e HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [astonbarclay.gb] INFO: Saving data for 115457692: {'auction_closing_time': 1764756000.0, 'created_time': 1762283180.530747, 'last_price_update_time': 1764788662.45445}
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115457692') HTTP/1.1" 204 0
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eccba90>
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/c14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fb75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252Fe7975616-795d-4513-9112-c2e8811f6396_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/e7975616-795d-4513-9112-c2e8811f6396_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252Fa590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/a590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fb19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/b19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff7db50>
2025-12-03 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fc7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cae5b50>
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252Fe5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/e5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba0a10>
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117522663, 'registration': 'BG71TYH', 'account': 'ALL016', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure Premium 5dr', 'mileage': 73967, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BG71TYH/2025-11-28/image/13263582-de89-4129-b8ad-da27f041afc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/85b90a0c-4f15-4a76-b544-b1d94079ddf6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/6c4c344c-9fd7-4c3f-9b6e-d9c0922a3f7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/17c7c74d-1515-46ee-8c8c-1393dc01f89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/4f84c371-6721-439b-bfa1-3c9c03567cba_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/8e79d118-0dea-4070-ad32-d836c5760015_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/0a639390-fac9-40f7-baa5-77cc06b7967f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/82d05868-f590-413e-86b9-273e950758f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/e0231349-9bd2-4092-b366-dd11e91a1688_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/3b5e0636-c630-47f0-8db6-ea95f90cff59_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/22 15K - 07/23 30K - 05/24 46K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 56K, 73K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2d428ee4-4a0c-43b5-8268-f2c247242ec4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117522663, 'registration': 'BG71TYH', 'account': 'ALL016', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure Premium 5dr', 'mileage': 73967, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BG71TYH/2025-11-28/image/13263582-de89-4129-b8ad-da27f041afc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/85b90a0c-4f15-4a76-b544-b1d94079ddf6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/6c4c344c-9fd7-4c3f-9b6e-d9c0922a3f7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/17c7c74d-1515-46ee-8c8c-1393dc01f89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/4f84c371-6721-439b-bfa1-3c9c03567cba_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/8e79d118-0dea-4070-ad32-d836c5760015_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/0a639390-fac9-40f7-baa5-77cc06b7967f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/82d05868-f590-413e-86b9-273e950758f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/e0231349-9bd2-4092-b366-dd11e91a1688_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/3b5e0636-c630-47f0-8db6-ea95f90cff59_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/22 15K - 07/23 30K - 05/24 46K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 56K, 73K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2d428ee4-4a0c-43b5-8268-f2c247242ec4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663
2025-12-03 19:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396c716b-c601-50de-8575-d6e91b9b5014 with scrape type 2
2025-12-03 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396c716b-c601-50de-8575-d6e91b9b5014 with scrape type 2
2025-12-03 19:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 396c716b-c601-50de-8575-d6e91b9b5014, identifier: 117522663
2025-12-03 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663
2025-12-03 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663
2025-12-03 19:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663 to the API
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27396c716b-c601-50de-8575-d6e91b9b5014%27 HTTP/1.1" 200 None
2025-12-03 19:04:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 396c716b-c601-50de-8575-d6e91b9b5014: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:04:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117522663?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '396c716b-c601-50de-8575-d6e91b9b5014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG71TYH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117522663',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 73967,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': 'SMC GROUP',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech Allure Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure Premium 5dr',
 'vin': None,
 'year': 2021}
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522663%27 HTTP/1.1" 200 None
2025-12-03 19:04:23 [astonbarclay.gb] INFO: Saving data for 117522663: {'auction_closing_time': 1764756000.0, 'created_time': 1764356647.815289, 'last_price_update_time': 1764788663.908026}
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117522663') HTTP/1.1" 204 0
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c9b10>
2025-12-03 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Ff936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/f936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebdb110>
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f851e50>
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117732998, 'registration': 'BV20JXN', 'account': 'RCI014', 'make': 'KIA', 'model': 'RIO HATCHBACK', 'derivative': '1.0 T GDi 2 5dr', 'mileage': 17591, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-04-04', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 5K 10K 15K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1d7797aa-c6e2-41b4-8509-f11c631ff4de.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117732998, 'registration': 'BV20JXN', 'account': 'RCI014', 'make': 'KIA', 'model': 'RIO HATCHBACK', 'derivative': '1.0 T GDi 2 5dr', 'mileage': 17591, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-04-04', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 5K 10K 15K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1d7797aa-c6e2-41b4-8509-f11c631ff4de.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a with identifier: 117732998
2025-12-03 19:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a with scrape type 1
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a
2025-12-03 19:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a, identifier: 117732998
2025-12-03 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fe683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/e683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a with identifier: 117732998
2025-12-03 19:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a with identifier: 117732998
2025-12-03 19:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a with identifier: 117732998 to the API
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277b73cd01-4e0a-5e73-85c6-8a634ca2e91a%27 HTTP/1.1" 200 None
2025-12-03 19:04:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7b73cd01-4e0a-5e73-85c6-8a634ca2e91a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:04:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117732998?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '7b73cd01-4e0a-5e73-85c6-8a634ca2e91a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV20JXN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117732998',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'RIO HATCHBACK',
 'odometer': 17591,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-04',
 'seller_name': None,
 'title': 'KIA RIO HATCHBACK 1.0 T GDi 2 5dr',
 'transmission': 'manual',
 'trim': '1.0 T GDi 2 5dr',
 'vin': None,
 'year': 2020}
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117732998%27 HTTP/1.1" 200 None
2025-12-03 19:04:25 [astonbarclay.gb] INFO: Saving data for 117732998: {'created_time': 1764788665.188245, 'last_price_update_time': 1764788665.188256}
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117732998') HTTP/1.1" 204 0
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea5afd0>
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7dbf90>
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117713732, 'registration': 'EA19KZY', 'account': 'WBA001', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi ST-Line 5dr 2WD', 'mileage': 48831, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA19KZY/2025-12-03/image/a57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/62539772-0929-45bc-a19f-30fde4938653_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/cd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/ca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/bd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/20- 7K, 03/21- 12K, 03/22- 14K, 10/22- 15K', 'remarks': 'VOSA STATES 15K, 24K, 35K, 48K', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d24fdff4-aa73-4fc2-b701-6f37fdcc4617.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117713732, 'registration': 'EA19KZY', 'account': 'WBA001', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi ST-Line 5dr 2WD', 'mileage': 48831, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA19KZY/2025-12-03/image/a57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/62539772-0929-45bc-a19f-30fde4938653_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/cd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/ca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/bd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/20- 7K, 03/21- 12K, 03/22- 14K, 10/22- 15K', 'remarks': 'VOSA STATES 15K, 24K, 35K, 48K', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d24fdff4-aa73-4fc2-b701-6f37fdcc4617.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5255142a-0e69-5a59-9b96-f50af2b6d3d0 with identifier: 117713732
2025-12-03 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0 with scrape type 1
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fa57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/a57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117709907, 'registration': 'NL18WKA', 'account': 'WBA001', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 65346, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-05-18', 'fuel': 'Petrol', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL18WKA/2025-12-03/image/93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/ebe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/a0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/19- 6K, ??- 13K, 06/21- 18K', 'remarks': 'VOSA STATES 34K, 52K, 56K, 62K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0256dc8c-3a72-480d-b7f6-7309524846c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117709907, 'registration': 'NL18WKA', 'account': 'WBA001', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 65346, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-05-18', 'fuel': 'Petrol', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL18WKA/2025-12-03/image/93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/ebe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/a0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/19- 6K, ??- 13K, 06/21- 18K', 'remarks': 'VOSA STATES 34K, 52K, 56K, 62K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0256dc8c-3a72-480d-b7f6-7309524846c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2684cc4-e1b4-578a-b33c-269f226805bb with identifier: 117709907
2025-12-03 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2684cc4-e1b4-578a-b33c-269f226805bb with scrape type 1
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/dbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/dcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec42f90>
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebba850>
2025-12-03 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edb6890>
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fc14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/c14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fa74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/a74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea95f10>
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed9ec50>
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f846a50>
2025-12-03 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/b0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119c14c890>
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba5450>
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F62539772-0929-45bc-a19f-30fde4938653_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/62539772-0929-45bc-a19f-30fde4938653_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cade4d0>
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea11410>
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fdbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/dbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea27010>
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252Fdcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/dcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547260?view=catalogue)
2025-12-03 19:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116986413?view=catalogue)
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee9c8d0>
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252F591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119c14ded0>
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb6790>
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252F0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/b19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/a590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/cab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252Fd1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/d1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fcd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/cd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee9e190>
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7b1a10>
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252Fb0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/b0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117733516?view=catalogue)
2025-12-03 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/e7975616-795d-4513-9112-c2e8811f6396_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117503025?view=catalogue)
2025-12-03 19:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f768150>
2025-12-03 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca0650>
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8100d0>
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252F595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/a57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252Fc3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/c3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/ab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed75910>
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM71RRU%252F2025-11-27%252Fimage%252F44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8327be07-600f-559f-84ad-913783c741c0
2025-12-03 19:04:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8327be07-600f-559f-84ad-913783c741c0, skipping ID generation
2025-12-03 19:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8327be07-600f-559f-84ad-913783c741c0 with scrape type 1
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8327be07-600f-559f-84ad-913783c741c0 from tracking dictionaries
2025-12-03 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8327be07-600f-559f-84ad-913783c741c0 sending to next pipeline
2025-12-03 19:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8327be07-600f-559f-84ad-913783c741c0, identifier: 117547260
2025-12-03 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cade010>
2025-12-03 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24XBM%252F2025-11-25%252Fimage%252Fcaf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c
2025-12-03 19:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72087037-5acb-5d9c-ba1b-1f15139a8e3c, skipping ID generation
2025-12-03 19:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c with scrape type 1
2025-12-03 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 72087037-5acb-5d9c-ba1b-1f15139a8e3c from tracking dictionaries
2025-12-03 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72087037-5acb-5d9c-ba1b-1f15139a8e3c sending to next pipeline
2025-12-03 19:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 72087037-5acb-5d9c-ba1b-1f15139a8e3c, identifier: 116986413
2025-12-03 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/e683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8327be07-600f-559f-84ad-913783c741c0 with identifier: 117547260
2025-12-03 19:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8327be07-600f-559f-84ad-913783c741c0 with identifier: 117547260
2025-12-03 19:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8327be07-600f-559f-84ad-913783c741c0 with identifier: 117547260 to the API
2025-12-03 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8327be07-600f-559f-84ad-913783c741c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM71RRU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547260',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 35797,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25326,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b2a5758c-a395-4c24-a4ae-5ed8cc6f7c34_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28908,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/1257b91b-0bcb-423b-b2f2-be31367bf0a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23806,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/b9d6f625-7b1f-4684-afb3-40fd23513fd0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26407,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/059468d2-d57c-47b7-ad57-c368088f0b68_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38168,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/31f2d8dd-ad85-4eef-bace-a9f471d39152_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49848,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/e5dbfb46-b252-4aa2-b947-a8db9d1d6a78_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48911,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/8b1d0f09-a5bb-4e5f-b8b9-febdf9bb8de6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56395,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/3af9aedf-dfc7-4fad-862f-940f3528040a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40431,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/0665bce3-c9a7-437e-9a0e-39825fa5eea8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327be07-600f-559f-84ad-913783c741c0/8327be07-600f-559f-84ad-913783c741c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM71RRU/2025-11-27/image/44258ea5-6f86-44c8-8e60-7d361b71c532_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Ultimate 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547260%27 HTTP/1.1" 200 None
2025-12-03 19:04:33 [astonbarclay.gb] INFO: Saving data for 117547260: {'created_time': 1764788673.165504, 'last_price_update_time': 1764788673.165514, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547260') HTTP/1.1" 204 0
2025-12-03 19:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 72087037-5acb-5d9c-ba1b-1f15139a8e3c with identifier: 116986413
2025-12-03 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 72087037-5acb-5d9c-ba1b-1f15139a8e3c with identifier: 116986413
2025-12-03 19:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 72087037-5acb-5d9c-ba1b-1f15139a8e3c with identifier: 116986413 to the API
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '72087037-5acb-5d9c-ba1b-1f15139a8e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV24XBM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116986413',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KAMIQ HATCHBACK',
 'odometer': 24001,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32208,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/2e76a4a8-0c9d-4322-b7b0-d9a2a0dd60bf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37405,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/27c154d9-7483-474a-82cc-1cb866f52d80_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/626f1407-8476-4572-af43-b8c8f0883555_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36839,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/3b4ca89e-8150-4414-ac7d-63848a00112d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43504,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/837155f3-679e-478c-9d58-e38500d1817b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47137,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/1c58fa08-a7ef-4702-866f-d1fd08d811c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34246,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/190e639a-6b3a-4493-b9c2-db6ff88c5b2f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41913,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/0ad02128-bd0c-43c6-be94-5a25dc1a9138_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72087037-5acb-5d9c-ba1b-1f15139a8e3c/72087037-5acb-5d9c-ba1b-1f15139a8e3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40162,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24XBM/2025-11-25/image/caf358f6-0459-414e-a102-176a7e6d153f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-13',
 'seller_name': 'Motability Operations',
 'title': 'SKODA KAMIQ HATCHBACK 1.5 TSI SE L 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI SE L 5dr',
 'vin': None,
 'year': 2024}
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116986413%27 HTTP/1.1" 200 None
2025-12-03 19:04:33 [astonbarclay.gb] INFO: Saving data for 116986413: {'created_time': 1764788673.516016, 'last_price_update_time': 1764788673.516026, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116986413') HTTP/1.1" 204 0
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee9e310>
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fb19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/b19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf29d0>
2025-12-03 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252Fa590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/a590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f812dd0>
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fcab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/cab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/a74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/ca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb8b0d0>
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY69HKZ%252F2025-12-03%252Fimage%252Fb75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30189d55-f6e9-5985-b93c-569f800edb33
2025-12-03 19:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30189d55-f6e9-5985-b93c-569f800edb33, skipping ID generation
2025-12-03 19:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30189d55-f6e9-5985-b93c-569f800edb33 with scrape type 1
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30189d55-f6e9-5985-b93c-569f800edb33 from tracking dictionaries
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30189d55-f6e9-5985-b93c-569f800edb33 sending to next pipeline
2025-12-03 19:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 30189d55-f6e9-5985-b93c-569f800edb33, identifier: 117733516
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f845410>
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252Fe7975616-795d-4513-9112-c2e8811f6396_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/e7975616-795d-4513-9112-c2e8811f6396_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb40550>
2025-12-03 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO25DZP%252F2025-11-27%252Fimage%252Fafea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2132145-db70-5a27-9757-1de434f8a896
2025-12-03 19:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2132145-db70-5a27-9757-1de434f8a896, skipping ID generation
2025-12-03 19:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2132145-db70-5a27-9757-1de434f8a896 with scrape type 1
2025-12-03 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a2132145-db70-5a27-9757-1de434f8a896 from tracking dictionaries
2025-12-03 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2132145-db70-5a27-9757-1de434f8a896 sending to next pipeline
2025-12-03 19:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a2132145-db70-5a27-9757-1de434f8a896, identifier: 117503025
2025-12-03 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 30189d55-f6e9-5985-b93c-569f800edb33 with identifier: 117733516
2025-12-03 19:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 30189d55-f6e9-5985-b93c-569f800edb33 with identifier: 117733516
2025-12-03 19:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 30189d55-f6e9-5985-b93c-569f800edb33 with identifier: 117733516 to the API
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '30189d55-f6e9-5985-b93c-569f800edb33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY69HKZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117733516',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR DIESEL ESTATE',
 'odometer': 26207,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34004,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c5d83d58-e00a-4506-8819-449be593fc76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32974,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/6145f900-e04a-4a7f-9581-0659b8e3abcf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31259,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/7602c03c-817b-47cc-83d2-21059ac95354_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35414,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/c7007ce6-8f99-47ca-be69-4598533b4c90_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40161,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/18387663-b0c7-4c7c-a26f-27c8b4c16147_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38380,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/595b0c44-ffed-4808-a899-225114cc3c8f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48691,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/dbfb7f6f-b365-4ae1-ac6a-0fa43a38ef0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46751,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/723689be-71de-47b7-a602-2b0ba0b12782_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30189d55-f6e9-5985-b93c-569f800edb33/30189d55-f6e9-5985-b93c-569f800edb33_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51793,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY69HKZ/2025-12-03/image/b75f5606-2575-476e-b3e9-864a0ff2f177_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-13',
 'seller_name': 'UKCGR',
 'title': 'LAND ROVER RANGE ROVER VELAR DIESEL ESTATE 2.0 D180 S 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 D180 S 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117733516%27 HTTP/1.1" 200 None
2025-12-03 19:04:35 [astonbarclay.gb] INFO: Saving data for 117733516: {'created_time': 1764788675.610028, 'last_price_update_time': 1764788675.610039}
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117733516') HTTP/1.1" 204 0
2025-12-03 19:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a2132145-db70-5a27-9757-1de434f8a896 with identifier: 117503025
2025-12-03 19:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a2132145-db70-5a27-9757-1de434f8a896 with identifier: 117503025
2025-12-03 19:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a2132145-db70-5a27-9757-1de434f8a896 with identifier: 117503025 to the API
2025-12-03 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 17,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'a2132145-db70-5a27-9757-1de434f8a896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO25DZP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117503025',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 15453,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36095,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/372c7ceb-adf8-44ee-8189-e60ca83b158b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32901,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/b0268349-a545-4e3f-9548-73593c9327f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/d0916774-8959-4f1f-abff-88e9b324077f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31231,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/ecb5eb82-9265-4f17-927f-a23636e90816_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54014,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/721c5701-0c3f-4c50-8806-176a5bd741e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54960,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/afea4e12-600b-4669-99d0-ac7d7b94f4a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56199,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/58022fad-eb28-4b78-8d80-c25c3895ebb9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74636,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/cab07dea-41f0-43ac-b40f-244b40200c27_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2132145-db70-5a27-9757-1de434f8a896/a2132145-db70-5a27-9757-1de434f8a896_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45107,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO25DZP/2025-11-27/image/591e1a4f-d6e1-40bd-b309-44b1305f9336_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-01',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 250e AMG Line Executive 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 250e AMG Line Executive 4dr Tip Auto',
 'vin': None,
 'year': 2025}
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117503025%27 HTTP/1.1" 200 None
2025-12-03 19:04:36 [astonbarclay.gb] INFO: Saving data for 117503025: {'created_time': 1764788676.752884, 'last_price_update_time': 1764788676.752895, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117503025') HTTP/1.1" 204 0
2025-12-03 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/62539772-0929-45bc-a19f-30fde4938653_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Ffe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff2ead0>
2025-12-03 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea00ed0>
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fa57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/a57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb27810>
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6f0a90>
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fe683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/e683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f6f0bd0>
2025-12-03 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252Febe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/ebe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee26e50>
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fa74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/a74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea36990>
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed46790>
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee16710>
2025-12-03 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee14910>
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f865650>
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f77cdd0>
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F62539772-0929-45bc-a19f-30fde4938653_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/62539772-0929-45bc-a19f-30fde4938653_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f84e710>
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/d1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/ab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fbd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/bd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252Fa0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/a0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/cd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eae9d50>
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252F75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb5d10>
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb78d0>
2025-12-03 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117705726?view=catalogue)
2025-12-03 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/ca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c5410>
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252Fd1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/d1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f846c50>
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252Fab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/ab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c6f10>
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed1dd10>
2025-12-03 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f84f450>
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f846610>
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fcd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/cd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba0610>
2025-12-03 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c7a10>
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS18GXE/2025-12-03/image/c3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117706537?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/ebe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735065?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/a0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117462219?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/c7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117213726?view=catalogue)
2025-12-03 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e151a10>
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ66XBY%252F2025-12-03%252Fimage%252F4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 70851189-346f-5565-8de4-84862d542f11
2025-12-03 19:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70851189-346f-5565-8de4-84862d542f11, skipping ID generation
2025-12-03 19:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70851189-346f-5565-8de4-84862d542f11 with scrape type 1
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70851189-346f-5565-8de4-84862d542f11 from tracking dictionaries
2025-12-03 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70851189-346f-5565-8de4-84862d542f11 sending to next pipeline
2025-12-03 19:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 70851189-346f-5565-8de4-84862d542f11, identifier: 117705726
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebe1d50>
2025-12-03 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/ca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 70851189-346f-5565-8de4-84862d542f11 with identifier: 117705726
2025-12-03 19:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 70851189-346f-5565-8de4-84862d542f11 with identifier: 117705726
2025-12-03 19:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 70851189-346f-5565-8de4-84862d542f11 with identifier: 117705726 to the API
2025-12-03 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '70851189-346f-5565-8de4-84862d542f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BJ66XBY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117705726',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PORSCHE',
 'model': 'MACAN DIESEL ESTATE',
 'odometer': 90439,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41297,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/f936bb6a-04a9-4784-9d7c-be3070c121a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43381,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/c14bccaa-92fe-474b-ad6b-5bc125982ac4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41321,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/28969dee-2fc8-4063-8f7d-0fc95b49e3ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38622,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/66ffbfae-468e-4a21-a09d-e7cf25d19771_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42930,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/b19a03d6-3f90-46be-8461-ab0dde225849_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52843,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/e683f051-c2ea-48a7-a43b-947860ae787a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27669,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/a74162b3-0d7b-40af-8233-f6f23db6a5a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50675,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/136c1edf-e1f4-4435-a0d2-ba0c6832711a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45214,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/5499f712-1d3d-4143-83c7-336a05209621_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50549,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/ab95ec7b-15e4-45d3-9c5f-bcda01f4b432_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70851189-346f-5565-8de4-84862d542f11/70851189-346f-5565-8de4-84862d542f11_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86007,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/BJ66XBY/2025-12-03/image/4a9cd17c-0cdc-4f59-bcae-a0694bc4a16f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': 'UKCGR',
 'title': 'PORSCHE MACAN DIESEL ESTATE S Diesel 5dr PDK',
 'transmission': 'automatic',
 'trim': 'S Diesel 5dr PDK',
 'vin': None,
 'year': 2016}
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117705726%27 HTTP/1.1" 200 None
2025-12-03 19:04:45 [astonbarclay.gb] INFO: Saving data for 117705726: {'created_time': 1764788685.18157, 'last_price_update_time': 1764788685.181581}
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117705726') HTTP/1.1" 204 0
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/bd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573762?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117709907?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117713732?view=catalogue)
2025-12-03 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee05290>
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS18GXE%252F2025-12-03%252Fimage%252Fc3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS18GXE/2025-12-03/image/c3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cf31a292-abe9-5a47-8e3b-1d1792b63e24
2025-12-03 19:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf31a292-abe9-5a47-8e3b-1d1792b63e24, skipping ID generation
2025-12-03 19:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf31a292-abe9-5a47-8e3b-1d1792b63e24 with scrape type 1
2025-12-03 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf31a292-abe9-5a47-8e3b-1d1792b63e24 from tracking dictionaries
2025-12-03 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf31a292-abe9-5a47-8e3b-1d1792b63e24 sending to next pipeline
2025-12-03 19:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cf31a292-abe9-5a47-8e3b-1d1792b63e24, identifier: 117706537
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e6e90>
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252Febe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/ebe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd59d0>
2025-12-03 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD66MYJ%252F2025-12-03%252Fimage%252F6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9abdc061-4429-5f01-a90a-e2a427c381f9
2025-12-03 19:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9abdc061-4429-5f01-a90a-e2a427c381f9, skipping ID generation
2025-12-03 19:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abdc061-4429-5f01-a90a-e2a427c381f9 with scrape type 1
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9abdc061-4429-5f01-a90a-e2a427c381f9 from tracking dictionaries
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9abdc061-4429-5f01-a90a-e2a427c381f9 sending to next pipeline
2025-12-03 19:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9abdc061-4429-5f01-a90a-e2a427c381f9, identifier: 117735065
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd5790>
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252Fa0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/a0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7f4f50>
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252F8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed0e610>
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU25NDC%252F2025-11-25%252Fimage%252F24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0663ed4b-bc9e-5a57-ab52-220e092def5b
2025-12-03 19:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0663ed4b-bc9e-5a57-ab52-220e092def5b, skipping ID generation
2025-12-03 19:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0663ed4b-bc9e-5a57-ab52-220e092def5b with scrape type 1
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0663ed4b-bc9e-5a57-ab52-220e092def5b from tracking dictionaries
2025-12-03 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0663ed4b-bc9e-5a57-ab52-220e092def5b sending to next pipeline
2025-12-03 19:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0663ed4b-bc9e-5a57-ab52-220e092def5b, identifier: 117462219
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee05350>
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252Fc7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/c7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7e66d0>
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74XJT%252F2025-11-17%252Fimage%252Fd06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a90106bc-5ec2-578c-9c3b-aa0782b46d85
2025-12-03 19:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a90106bc-5ec2-578c-9c3b-aa0782b46d85, skipping ID generation
2025-12-03 19:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90106bc-5ec2-578c-9c3b-aa0782b46d85 with scrape type 1
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a90106bc-5ec2-578c-9c3b-aa0782b46d85 from tracking dictionaries
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a90106bc-5ec2-578c-9c3b-aa0782b46d85 sending to next pipeline
2025-12-03 19:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a90106bc-5ec2-578c-9c3b-aa0782b46d85, identifier: 117213726
2025-12-03 19:04:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117732515, 'registration': 'LN19POV', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line 5dr Auto', 'mileage': 42777, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LN19POV/2025-12-03/image/6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/afdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/c0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/e4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/aee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSATANDING RECALL VOSA STATES 27K, 32K, 37K, 41K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/256acd7c-a191-4f5f-9e06-80fb0feb1fcf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117732515, 'registration': 'LN19POV', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line 5dr Auto', 'mileage': 42777, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LN19POV/2025-12-03/image/6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/afdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/c0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/e4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/aee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSATANDING RECALL VOSA STATES 27K, 32K, 37K, 41K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/256acd7c-a191-4f5f-9e06-80fb0feb1fcf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 with identifier: 117732515
2025-12-03 19:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 with scrape type 1
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cf31a292-abe9-5a47-8e3b-1d1792b63e24 with identifier: 117706537
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cf31a292-abe9-5a47-8e3b-1d1792b63e24 with identifier: 117706537
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157485 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157485
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cf31a292-abe9-5a47-8e3b-1d1792b63e24 spider: astonbarclay.gb
2025-12-03 19:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: cf31a292-abe9-5a47-8e3b-1d1792b63e24 due to rule: high_mileage_for_country.json, error: 157485 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157485
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'cf31a292-abe9-5a47-8e3b-1d1792b63e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS18GXE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117706537',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '4 SERIES GRAN DIESEL COUPE',
 'odometer': 97857,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33318,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4ada9753-fcee-455b-9c13-7be269d99efb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31771,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/1c6b906f-e3b9-4d56-81cc-cf55287856b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33492,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/88cd4bfa-4556-4b65-b523-86a72eb74883_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32040,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/5efcf427-cd3f-4508-bc51-869d7eccdc29_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49095,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/65308738-f653-4479-b537-3f7386fba1f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35230,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4e06c232-6164-47d7-b16c-88e6e241f16d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44184,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/e7975616-795d-4513-9112-c2e8811f6396_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42004,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/4d735f27-7e27-4399-b7e9-70a87e2e981d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42866,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/36b3cd30-4a50-4950-bf7f-8a95df007bdd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54226,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/75dbb62a-66f4-4580-9a14-5cdb72418e4d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47609,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/d1870040-a934-47d7-9b9e-4cecb00ce550_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf31a292-abe9-5a47-8e3b-1d1792b63e24/cf31a292-abe9-5a47-8e3b-1d1792b63e24_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47180,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS18GXE/2025-12-03/image/c3c662ed-cf17-4385-be9e-41bc722f4bc8_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': 'UKCGR',
 'title': 'BMW 4 SERIES GRAN DIESEL COUPE 435d xDrive M Sport 5dr Auto '
          '[Professional Media]',
 'transmission': 'automatic',
 'trim': '435d xDrive M Sport 5dr Auto [Professional Media]',
 'vin': None,
 'year': 2018}
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117706537%27 HTTP/1.1" 200 None
2025-12-03 19:04:47 [astonbarclay.gb] INFO: Saving data for 117706537: {'created_time': 1764788687.745316, 'last_price_update_time': 1764788687.745327}
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117706537') HTTP/1.1" 204 0
2025-12-03 19:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9abdc061-4429-5f01-a90a-e2a427c381f9 with identifier: 117735065
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9abdc061-4429-5f01-a90a-e2a427c381f9 with identifier: 117735065
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158410 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158410
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9abdc061-4429-5f01-a90a-e2a427c381f9 spider: astonbarclay.gb
2025-12-03 19:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9abdc061-4429-5f01-a90a-e2a427c381f9 due to rule: high_mileage_for_country.json, error: 158410 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158410
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '9abdc061-4429-5f01-a90a-e2a427c381f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BD66MYJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117735065',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER ESTATE',
 'odometer': 98432,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37983,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/7d2d56f1-4407-4218-9997-ae01767cc085_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42379,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6224998c-41c7-4741-95ff-7c2f157ab3fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40591,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/8a6878e5-c213-4ea5-bea3-ef36341995e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39534,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/dcc0e07b-4b74-4482-af1f-05d6741cc2ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46983,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/b0b7b58b-196d-4ec8-9b7f-2ce2ce279bc1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52123,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/a590e182-e952-4a10-903f-8b2a96d04df2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57563,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/209bbc0a-a87d-4154-860c-570e9258dfeb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42962,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/3b6c4ac9-14f6-4d80-8229-e2eab7cb2033_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45203,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/240a20cf-b7c2-46de-8ed2-7f9ae906905f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48248,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/0775dd16-497a-464c-8cbd-403a0187a5d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abdc061-4429-5f01-a90a-e2a427c381f9/9abdc061-4429-5f01-a90a-e2a427c381f9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55484,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD66MYJ/2025-12-03/image/6f5f6f4c-6a71-424f-bbd7-83a9d2eb9612_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': 'UKCGR',
 'title': 'MITSUBISHI OUTLANDER ESTATE 2.0 PHEV GX4h 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 PHEV GX4h 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735065%27 HTTP/1.1" 200 None
2025-12-03 19:04:47 [astonbarclay.gb] INFO: Saving data for 117735065: {'created_time': 1764788687.949784, 'last_price_update_time': 1764788687.949793}
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117735065') HTTP/1.1" 204 0
2025-12-03 19:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0663ed4b-bc9e-5a57-ab52-220e092def5b with identifier: 117462219
2025-12-03 19:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0663ed4b-bc9e-5a57-ab52-220e092def5b with identifier: 117462219
2025-12-03 19:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0663ed4b-bc9e-5a57-ab52-220e092def5b with identifier: 117462219 to the API
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '0663ed4b-bc9e-5a57-ab52-220e092def5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AU25NDC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117462219',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 7739,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39936,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/66cd1b77-454e-434b-bd0c-4d4b68b5b7ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43359,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/cc6546c9-54d4-471e-a334-9e93ce01700e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36070,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df41175a-278e-477b-b33c-b78a65d2d3cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36990,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/e0ff4b6d-21da-495c-a500-8e92b0e5c9e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49086,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/df1d0d3e-5462-45d7-8452-64a080e0f396_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55043,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/273191b7-7a9f-403a-86a1-c83de7489e85_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50818,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/0a1bd72b-0037-416c-9026-0d63e4e1c450_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58040,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/24f8dd56-8924-4fcd-88b4-2e770d56712c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47986,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/c2a4ac98-b0c1-4ba7-a902-4ce2922490e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0663ed4b-bc9e-5a57-ab52-220e092def5b/0663ed4b-bc9e-5a57-ab52-220e092def5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61073,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU25NDC/2025-11-25/image/a4da78c9-1b75-450f-ad6c-fcec36d849a9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-18',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT CLIO HATCHBACK 1.6 E-TECH full hybrid 145 Evolution 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH full hybrid 145 Evolution 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117462219%27 HTTP/1.1" 200 None
2025-12-03 19:04:48 [astonbarclay.gb] INFO: Saving data for 117462219: {'created_time': 1764788688.339263, 'last_price_update_time': 1764788688.339272, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117462219') HTTP/1.1" 204 0
2025-12-03 19:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a90106bc-5ec2-578c-9c3b-aa0782b46d85 with identifier: 117213726
2025-12-03 19:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a90106bc-5ec2-578c-9c3b-aa0782b46d85 with identifier: 117213726
2025-12-03 19:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a90106bc-5ec2-578c-9c3b-aa0782b46d85 with identifier: 117213726 to the API
2025-12-03 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'a90106bc-5ec2-578c-9c3b-aa0782b46d85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY74XJT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117213726',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 7781,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38145,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/81770778-eed9-48ce-a2a0-5da14a0bd099_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44341,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/047e5903-84b8-485b-8485-a1005247762a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37680,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/cbb15b42-73de-4fe2-a44a-af642bab2e0e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40802,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/f6ced0dd-68da-4504-9cc9-1a47a2b4e5f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33989,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/32cd3f24-2e45-42b7-b63a-fd9e4e5348e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52730,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d034d020-da5d-40af-84a3-f3ad23488d9a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33611,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/67b98bee-b07c-4831-8538-91ca4730cdf1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/0e57f58d-bf0a-476d-93c7-69cfc19c7689_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90106bc-5ec2-578c-9c3b-aa0782b46d85/a90106bc-5ec2-578c-9c3b-aa0782b46d85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74XJT/2025-11-17/image/d06a13b3-205b-4fb9-a2fb-42bce6b51443_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-20',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power N-Connecta 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power N-Connecta 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213726%27 HTTP/1.1" 200 None
2025-12-03 19:04:49 [astonbarclay.gb] INFO: Saving data for 117213726: {'created_time': 1764788689.553283, 'last_price_update_time': 1764788689.553294, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117213726') HTTP/1.1" 204 0
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/a63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/b973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Fafdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/afdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/cb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf3790>
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Fbd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/bd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec500d0>
2025-12-03 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAV73YHP%252F2025-11-28%252Fimage%252F9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec
2025-12-03 19:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a21cd41-6cdd-5963-990c-6a2836ad0aec, skipping ID generation
2025-12-03 19:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec with scrape type 1
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a21cd41-6cdd-5963-990c-6a2836ad0aec from tracking dictionaries
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a21cd41-6cdd-5963-990c-6a2836ad0aec sending to next pipeline
2025-12-03 19:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1a21cd41-6cdd-5963-990c-6a2836ad0aec, identifier: 117573762
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec48190>
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fd33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf1950>
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fcaed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea01250>
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed00b50>
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL18WKA%252F2025-12-03%252Fimage%252F9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2684cc4-e1b4-578a-b33c-269f226805bb
2025-12-03 19:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2684cc4-e1b4-578a-b33c-269f226805bb, skipping ID generation
2025-12-03 19:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2684cc4-e1b4-578a-b33c-269f226805bb with scrape type 1
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2684cc4-e1b4-578a-b33c-269f226805bb from tracking dictionaries
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2684cc4-e1b4-578a-b33c-269f226805bb sending to next pipeline
2025-12-03 19:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f2684cc4-e1b4-578a-b33c-269f226805bb, identifier: 117709907
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc3250>
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19KZY%252F2025-12-03%252Fimage%252Ffe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0
2025-12-03 19:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5255142a-0e69-5a59-9b96-f50af2b6d3d0, skipping ID generation
2025-12-03 19:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0 with scrape type 1
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5255142a-0e69-5a59-9b96-f50af2b6d3d0 from tracking dictionaries
2025-12-03 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5255142a-0e69-5a59-9b96-f50af2b6d3d0 sending to next pipeline
2025-12-03 19:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5255142a-0e69-5a59-9b96-f50af2b6d3d0, identifier: 117713732
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf1550>
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252F8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402212?view=catalogue)
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Fc0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/c0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1a21cd41-6cdd-5963-990c-6a2836ad0aec with identifier: 117573762
2025-12-03 19:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1a21cd41-6cdd-5963-990c-6a2836ad0aec with identifier: 117573762
2025-12-03 19:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1a21cd41-6cdd-5963-990c-6a2836ad0aec with identifier: 117573762 to the API
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1a21cd41-6cdd-5963-990c-6a2836ad0aec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AV73YHP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573762',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 25054,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37694,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6e028b5c-00bf-4cd9-a191-dcd9e41c61ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39191,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/02655312-8807-4f2d-9077-d1f4b47bcbbd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/e5360bf2-9159-44b2-8916-97b7bf296e79_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/6697cd41-395d-4f2a-b3fa-981d0eb4a8c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55701,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/9c5c6df3-37f6-42d5-aeb5-9c9553e79299_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37477,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/35f67752-b946-4a11-bd8a-f81aa629db66_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58053,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/056ae33c-5249-487a-bc78-4bc40fb8dea4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49623,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/ab4f8931-0a33-4052-823f-cf77518f20a1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49798,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/90e50e5e-adb1-436b-9769-dd1edf5f066a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a21cd41-6cdd-5963-990c-6a2836ad0aec/1a21cd41-6cdd-5963-990c-6a2836ad0aec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52093,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AV73YHP/2025-11-28/image/c7b3d00d-6726-4055-8e18-b0a355c88a37_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-13',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi SE Connect 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 TGDi SE Connect 5dr 2WD',
 'vin': None,
 'year': 2024}
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573762%27 HTTP/1.1" 200 None
2025-12-03 19:04:52 [astonbarclay.gb] INFO: Saving data for 117573762: {'created_time': 1764788692.389712, 'last_price_update_time': 1764788692.389724, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573762') HTTP/1.1" 204 0
2025-12-03 19:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f2684cc4-e1b4-578a-b33c-269f226805bb with identifier: 117709907
2025-12-03 19:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f2684cc4-e1b4-578a-b33c-269f226805bb with identifier: 117709907
2025-12-03 19:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f2684cc4-e1b4-578a-b33c-269f226805bb with identifier: 117709907 to the API
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'f2684cc4-e1b4-578a-b33c-269f226805bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL18WKA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117709907',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'ZS HATCHBACK',
 'odometer': 65346,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25023,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/93487f39-b505-4d1a-831f-99e187bebead_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24248,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/4396b6a0-2ec8-4d84-a1b3-4d05ee5c60de_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22766,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/5d1af5eb-df8f-4049-866d-23e4fe7a0c29_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21882,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/90eb7815-1d77-458f-b120-b95ab3754018_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40695,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/8b39709c-9965-4c44-9d84-f470558a20c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87125,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/3c981c65-ade0-4f92-a8e7-1322887a7f82_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75918,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/9a498229-4959-4f01-99cb-c7c6ec8827c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49386,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/ebe2a6ae-9c6e-4745-b910-0fc48896cfe9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2684cc4-e1b4-578a-b33c-269f226805bb/f2684cc4-e1b4-578a-b33c-269f226805bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38172,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NL18WKA/2025-12-03/image/a0a10823-3853-4708-a921-4fa54f2321b4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seller_name': 'UKCGR',
 'title': 'MG MOTOR UK ZS HATCHBACK 1.5 VTi-TECH Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Exclusive 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117709907%27 HTTP/1.1" 200 None
2025-12-03 19:04:52 [astonbarclay.gb] INFO: Saving data for 117709907: {'created_time': 1764788692.750926, 'last_price_update_time': 1764788692.750936}
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117709907') HTTP/1.1" 204 0
2025-12-03 19:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5255142a-0e69-5a59-9b96-f50af2b6d3d0 with identifier: 117713732
2025-12-03 19:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5255142a-0e69-5a59-9b96-f50af2b6d3d0 with identifier: 117713732
2025-12-03 19:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5255142a-0e69-5a59-9b96-f50af2b6d3d0 with identifier: 117713732 to the API
2025-12-03 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '5255142a-0e69-5a59-9b96-f50af2b6d3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA19KZY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117713732',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 48831,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32465,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/a57e30b8-9fd4-486e-91e1-c218f0f9fde6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34063,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/4b964f01-56eb-4514-94f8-a36d1f4c5999_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24729,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/62539772-0929-45bc-a19f-30fde4938653_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29751,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/cd3bab67-88a0-4201-92ca-999d526e32d0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48727,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/84dba2b5-356e-4d98-8fc9-046bbc1ce4cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91818,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/ca5810f9-c55d-420e-9be1-e21ac82178a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90006,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/fe53bba8-c8b1-47ac-b37a-e460ace748e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53937,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/8f844aff-b3e7-4304-acb5-099e4c1220ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5255142a-0e69-5a59-9b96-f50af2b6d3d0/5255142a-0e69-5a59-9b96-f50af2b6d3d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28110,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EA19KZY/2025-12-03/image/bd16887c-24b0-4b6a-bb58-4bb68a79134f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': 'UKCGR',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 TDCi ST-Line 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 TDCi ST-Line 5dr 2WD',
 'vin': None,
 'year': 2019}
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117713732%27 HTTP/1.1" 200 None
2025-12-03 19:04:53 [astonbarclay.gb] INFO: Saving data for 117713732: {'created_time': 1764788693.13013, 'last_price_update_time': 1764788693.13014}
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117713732') HTTP/1.1" 204 0
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/e4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702052?view=catalogue)
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621873?view=catalogue)
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117707470?view=catalogue)
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Fe4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/e4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb4690>
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fd1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119ca5a3d0>
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fa63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/a63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd7810>
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb40d0>
2025-12-03 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Fb973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/b973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebb5590>
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd7b10>
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fcb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/cb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec25e50>
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252F0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebf8550>
2025-12-03 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV75WFO%252F2025-11-25%252Fimage%252Fc1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a
2025-12-03 19:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b33a2d32-5fd9-5bad-94bb-1e27b34a722a, skipping ID generation
2025-12-03 19:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a with scrape type 1
2025-12-03 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b33a2d32-5fd9-5bad-94bb-1e27b34a722a from tracking dictionaries
2025-12-03 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b33a2d32-5fd9-5bad-94bb-1e27b34a722a sending to next pipeline
2025-12-03 19:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b33a2d32-5fd9-5bad-94bb-1e27b34a722a, identifier: 117402212
2025-12-03 19:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b33a2d32-5fd9-5bad-94bb-1e27b34a722a with identifier: 117402212
2025-12-03 19:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b33a2d32-5fd9-5bad-94bb-1e27b34a722a with identifier: 117402212
2025-12-03 19:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b33a2d32-5fd9-5bad-94bb-1e27b34a722a with identifier: 117402212 to the API
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b33a2d32-5fd9-5bad-94bb-1e27b34a722a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV75WFO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117402212',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 1319,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36668,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/ca432ed5-8943-4c73-ac02-01c8f3c16769_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39631,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/365ca490-8d21-4f9c-affc-b8e402583c2f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/5b02cf29-5d6b-48fe-93c1-c68cb178df4d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42089,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/37e57fda-1a4a-4caa-b9e8-d3070c2db575_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55285,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/eefe792a-ed4b-4373-a132-39c0f6a31b3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82277,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/c1fc05aa-3a43-4591-8e92-3feec1b98d98_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45898,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/09f417b2-610e-4330-a3b4-e95a927c1025_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90777,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/0027a1a0-729a-4f42-85b2-d4645e848de4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41389,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/8ec0a8bb-0276-4722-a642-e5cfaf4d4b73_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33a2d32-5fd9-5bad-94bb-1e27b34a722a/b33a2d32-5fd9-5bad-94bb-1e27b34a722a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49174,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV75WFO/2025-11-25/image/496c9b80-19b1-48cf-9df1-3b4c02d578f4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-10-16',
 'seller_name': 'Motability Operations',
 'title': 'VOLVO XC40 ESTATE 2.0 B4P Plus Black Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 B4P Plus Black Edition 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402212%27 HTTP/1.1" 200 None
2025-12-03 19:04:55 [astonbarclay.gb] INFO: Saving data for 117402212: {'created_time': 1764788695.648149, 'last_price_update_time': 1764788695.648159, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117402212') HTTP/1.1" 204 0
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/8220c218-9c99-480c-812a-92da897c645b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/afdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea47e10>
2025-12-03 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252Fc5b614da-d633-4468-8595-31409c690023_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea96890>
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252Ff4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb93f90>
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee89c90>
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fe4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/e4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba12d0>
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP17MFJ%252F2025-12-03%252Fimage%252F293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a
2025-12-03 19:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af8dba93-5e7a-5e46-b5ef-4fb2295aa27a, skipping ID generation
2025-12-03 19:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a with scrape type 1
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a from tracking dictionaries
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af8dba93-5e7a-5e46-b5ef-4fb2295aa27a sending to next pipeline
2025-12-03 19:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: af8dba93-5e7a-5e46-b5ef-4fb2295aa27a, identifier: 117702052
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eeb5a50>
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMM67ZSN%252F2025-12-03%252Fimage%252F3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67632d15-8b25-59ec-88f5-39d0870d2a5f
2025-12-03 19:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67632d15-8b25-59ec-88f5-39d0870d2a5f, skipping ID generation
2025-12-03 19:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67632d15-8b25-59ec-88f5-39d0870d2a5f with scrape type 1
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67632d15-8b25-59ec-88f5-39d0870d2a5f from tracking dictionaries
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67632d15-8b25-59ec-88f5-39d0870d2a5f sending to next pipeline
2025-12-03 19:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 67632d15-8b25-59ec-88f5-39d0870d2a5f, identifier: 117621873
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f9d6d10>
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG72VNT%252F2025-12-03%252Fimage%252Fb2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600 saved to cache
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e5bef35-148d-549e-99fc-2fa26477e347
2025-12-03 19:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e5bef35-148d-549e-99fc-2fa26477e347, skipping ID generation
2025-12-03 19:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5bef35-148d-549e-99fc-2fa26477e347 with scrape type 1
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6e5bef35-148d-549e-99fc-2fa26477e347 from tracking dictionaries
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e5bef35-148d-549e-99fc-2fa26477e347 sending to next pipeline
2025-12-03 19:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6e5bef35-148d-549e-99fc-2fa26477e347, identifier: 117707470
2025-12-03 19:04:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117711420, 'registration': 'DX69RWY', 'account': 'WBA001', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.4 PHEV 5hs 5dr Auto', 'mileage': 80525, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-09-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-07', 'doors': 5, 'engineSize': 2360, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/a01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/20- 15k, 05/23- 53k, 06/24- 58k, 03/25- 70k', 'remarks': 'VOSA STATES 45K, 53K, 58K, 72K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b2e5862e-1ab5-4ab2-8837-b562b9bddda0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117711420, 'registration': 'DX69RWY', 'account': 'WBA001', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.4 PHEV 5hs 5dr Auto', 'mileage': 80525, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-09-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-07', 'doors': 5, 'engineSize': 2360, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/a01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/20- 15k, 05/23- 53k, 06/24- 58k, 03/25- 70k', 'remarks': 'VOSA STATES 45K, 53K, 58K, 72K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b2e5862e-1ab5-4ab2-8837-b562b9bddda0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dc4eb14-9e97-519e-b237-3f47d8bc4177 with identifier: 117711420
2025-12-03 19:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177 with scrape type 1
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Faee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/aee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: af8dba93-5e7a-5e46-b5ef-4fb2295aa27a with identifier: 117702052
2025-12-03 19:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: af8dba93-5e7a-5e46-b5ef-4fb2295aa27a with identifier: 117702052
2025-12-03 19:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: af8dba93-5e7a-5e46-b5ef-4fb2295aa27a with identifier: 117702052 to the API
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'af8dba93-5e7a-5e46-b5ef-4fb2295aa27a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP17MFJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117702052',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK DIESEL',
 'odometer': 78096,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f32b01ce-af38-450c-a119-5e2b9ef2ce88_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39904,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ca3a1153-8fe2-4057-9f3b-3a6b410b9b7c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32727,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/ece7e74f-9e41-48c6-8293-402b125debcb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33343,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/292ccbaa-e0e5-4246-ae44-d76ed0e7307f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55534,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/6c4f0fe4-e19e-4261-8ac3-8eb9dcf7ba81_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67906,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/95a217c2-64d1-4fe2-a093-87066ca50c99_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52745,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/293f040a-c993-43f2-8a73-ec8e6d5b1b76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58556,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/f4da5d9a-311c-4532-b9c2-15f2dc0502d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46286,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/a63ac4b1-1b1b-4066-ae54-57c4fc0fe19b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8dba93-5e7a-5e46-b5ef-4fb2295aa27a/af8dba93-5e7a-5e46-b5ef-4fb2295aa27a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60869,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP17MFJ/2025-12-03/image/b973106a-e8c6-4e09-a234-6b34efa79776_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'MINI HATCHBACK DIESEL 1.5 One D 3dr',
 'transmission': 'manual',
 'trim': '1.5 One D 3dr',
 'vin': None,
 'year': 2017}
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702052%27 HTTP/1.1" 200 None
2025-12-03 19:04:58 [astonbarclay.gb] INFO: Saving data for 117702052: {'created_time': 1764788698.329883, 'last_price_update_time': 1764788698.329893, 'auction_closing_time': 1765360800.0}
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117702052') HTTP/1.1" 204 0
2025-12-03 19:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 67632d15-8b25-59ec-88f5-39d0870d2a5f with identifier: 117621873
2025-12-03 19:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 67632d15-8b25-59ec-88f5-39d0870d2a5f with identifier: 117621873
2025-12-03 19:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 67632d15-8b25-59ec-88f5-39d0870d2a5f with identifier: 117621873 to the API
2025-12-03 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '67632d15-8b25-59ec-88f5-39d0870d2a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MM67ZSN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117621873',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'SPORTAGE DIESEL ESTATE',
 'odometer': 83155,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34691,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/e40bc707-ea65-45c2-9b32-a929441a9cd5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/806daf72-a6f4-41e7-b432-3b08b4961ee0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32044,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/29a632a8-25d9-48e9-9a7f-6073e0757319_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31953,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/a4de3da0-935b-475f-8b97-3e98409a9e35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45841,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/95b82a40-4913-4d9b-9516-f49b3be69282_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48726,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/53918841-e8a2-408a-b4fd-84018fd187d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53602,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/3a187bc1-cff1-4761-aa7d-ef20e6d2ea58_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67632d15-8b25-59ec-88f5-39d0870d2a5f/67632d15-8b25-59ec-88f5-39d0870d2a5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52583,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MM67ZSN/2025-12-03/image/2903fc31-30e9-4686-b2f4-202a321bde33_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': 'SMC GROUP',
 'title': 'KIA SPORTAGE DIESEL ESTATE 1.7 CRDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi ISG 2 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621873%27 HTTP/1.1" 200 None
2025-12-03 19:04:59 [astonbarclay.gb] INFO: Saving data for 117621873: {'created_time': 1764788699.386572, 'last_price_update_time': 1764788699.386583, 'auction_closing_time': 1765360800.0}
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117621873') HTTP/1.1" 204 0
2025-12-03 19:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6e5bef35-148d-549e-99fc-2fa26477e347 with identifier: 117707470
2025-12-03 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6e5bef35-148d-549e-99fc-2fa26477e347 with identifier: 117707470
2025-12-03 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 13, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 28603, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707470', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'lg72vnt', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '6e5bef35-148d-549e-99fc-2fa26477e347', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 26758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28702}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28583}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 35310}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 93893}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 86128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 42226}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 24557}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43286}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39559}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 82853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_12.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 27682}], 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 46031} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '6e5bef35-148d-549e-99fc-2fa26477e347',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lg72vnt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707470',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 28603,
     'odometer_in_km': 46031,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27010,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26758,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28702,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28583,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35310,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 93893,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86128,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42226,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24557,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43286,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39559,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82853,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27682,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '109kw life pure 52kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-03 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 6e5bef35-148d-549e-99fc-2fa26477e347 spider: astonbarclay.gb
2025-12-03 19:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6e5bef35-148d-549e-99fc-2fa26477e347 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 13, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 28603, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707470', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'lg72vnt', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '6e5bef35-148d-549e-99fc-2fa26477e347', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 26758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28702}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28583}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 35310}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 93893}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 86128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 42226}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 24557}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43286}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39559}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 82853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_12.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 27682}], 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 46031} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '6e5bef35-148d-549e-99fc-2fa26477e347',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lg72vnt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707470',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 28603,
     'odometer_in_km': 46031,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27010,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26758,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28702,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28583,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35310,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 93893,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86128,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42226,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24557,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43286,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39559,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82853,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27682,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '109kw life pure 52kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '6e5bef35-148d-549e-99fc-2fa26477e347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LG72VNT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117707470',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'ID.4 ESTATE',
 'odometer': 28603,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27010,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/1da24e11-6f4d-4aec-bdb6-cf2fc1e798c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26758,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0910f2fc-806e-44e1-9fd3-6ed8a81bde4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28702,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/0e844ca4-2a72-48cc-9ac9-d37478d06baf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28583,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/e8cc98c6-dc71-4876-93fb-14f18c53cf77_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35310,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/2a27c6d6-9c29-4ce8-b1ec-5d9991e75ea5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93893,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/b2067cac-8002-4c4f-8ca4-43b05c4b9309_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86128,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/4e83dc4f-ef7e-4ad9-bed1-721e4126d479_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42226,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/ab9e733e-29cd-4031-bbcb-0dbd9d7c10c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24557,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/caed324e-eab8-4739-a43c-5c0b4a32d97b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43286,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/9395a3a0-3662-4fc1-9735-708153f723dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39559,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/d33e9f77-e5f7-43e8-9c81-bcaeea9d29af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82853,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/8482f5ce-f373-49a4-ad0e-06ec35e23571_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e5bef35-148d-549e-99fc-2fa26477e347/6e5bef35-148d-549e-99fc-2fa26477e347_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27682,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LG72VNT/2025-12-03/image/76258953-77a1-451b-9cd9-f8bb7907452e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN ID.4 ESTATE 109kW Life Pure 52kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '109kW Life Pure 52kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707470%27 HTTP/1.1" 200 None
2025-12-03 19:04:59 [astonbarclay.gb] INFO: Saving data for 117707470: {'created_time': 1764788699.611036, 'last_price_update_time': 1764788699.611044, 'auction_closing_time': 1765792800.0}
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117707470') HTTP/1.1" 204 0
2025-12-03 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/c0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/e4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/c3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/f4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252Fd84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee149d0>
2025-12-03 19:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d5bd0>
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecc8f50>
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fd1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f750bd0>
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e176310>
2025-12-03 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8ba3d0>
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ecaba10>
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F8220c218-9c99-480c-812a-92da897c645b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/8220c218-9c99-480c-812a-92da897c645b_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed64e90>
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Fafdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/afdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117310319?view=catalogue)
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec5df90>
2025-12-03 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252F0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623718?view=catalogue)
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea44250>
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252Fef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613308?view=catalogue)
2025-12-03 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f86b850>
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eafa7d0>
2025-12-03 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Fc0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/c0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff25590>
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Fe4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/e4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e16ed50>
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252F5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eafae50>
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Fc3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/c3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf9650>
2025-12-03 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Ff4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/f4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699895?view=catalogue)
2025-12-03 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF68PLV/2025-12-03/image/cfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117624796?view=catalogue)
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb9bc90>
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM25YTG%252F2025-11-19%252Fimage%252F189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f
2025-12-03 19:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f, skipping ID generation
2025-12-03 19:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f with scrape type 1
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f from tracking dictionaries
2025-12-03 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f sending to next pipeline
2025-12-03 19:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f, identifier: 117310319
2025-12-03 19:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19OVH/2025-12-03/image/7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117695935?view=catalogue)
2025-12-03 19:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f with identifier: 117310319
2025-12-03 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f with identifier: 117310319
2025-12-03 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'kia niro ev estate 150kw 2 nav 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'niro ev estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4514, 'odometer_reading_unit': 'mi', 'registration_date': '2025-06-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310319', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '150kw 2 nav 65kwh 5dr auto', 'license_plate': 'lm25ytg', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '894c6fd0-3c5b-551b-a222-dbc47d0c9c3f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39234}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39709}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40522}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52726}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50233}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45269}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43434}], 'current_year_diff': 0, 'age_in_months': 5, 'make_model': 'kia niro ev estate', 'sanitized_make': 'kia', 'odometer_in_km': 7264} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 5,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 0,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '894c6fd0-3c5b-551b-a222-dbc47d0c9c3f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lm25ytg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310319',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'kia',
     'make_model': 'kia niro ev estate',
     'model': 'niro ev estate',
     'odometer': 4514,
     'odometer_in_km': 7264,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39234,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39998,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39709,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40522,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45000,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52726,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50233,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45269,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43434,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2025-06-14',
     'sanitized_make': 'kia',
     'seller_name': 'motability operations',
     'title': 'kia niro ev estate 150kw 2 nav 65kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 2 nav 65kwh 5dr auto',
     'vin': None,
     'year': 2025}
2025-12-03 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f spider: astonbarclay.gb
2025-12-03 19:05:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 894c6fd0-3c5b-551b-a222-dbc47d0c9c3f due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'kia niro ev estate 150kw 2 nav 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'niro ev estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4514, 'odometer_reading_unit': 'mi', 'registration_date': '2025-06-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310319', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '150kw 2 nav 65kwh 5dr auto', 'license_plate': 'lm25ytg', 'year': 2025, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '894c6fd0-3c5b-551b-a222-dbc47d0c9c3f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39234}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39709}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40522}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52726}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50233}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45269}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43434}], 'current_year_diff': 0, 'age_in_months': 5, 'make_model': 'kia niro ev estate', 'sanitized_make': 'kia', 'odometer_in_km': 7264} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 5,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 0,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '894c6fd0-3c5b-551b-a222-dbc47d0c9c3f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lm25ytg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310319',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'kia',
     'make_model': 'kia niro ev estate',
     'model': 'niro ev estate',
     'odometer': 4514,
     'odometer_in_km': 7264,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39234,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39998,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39709,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40522,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45000,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52726,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50233,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45269,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43434,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2025-06-14',
     'sanitized_make': 'kia',
     'seller_name': 'motability operations',
     'title': 'kia niro ev estate 150kw 2 nav 65kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 2 nav 65kwh 5dr auto',
     'vin': None,
     'year': 2025}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '894c6fd0-3c5b-551b-a222-dbc47d0c9c3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM25YTG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310319',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'NIRO EV ESTATE',
 'odometer': 4514,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39234,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/778f43e2-773e-4f65-8c0b-39698dfa19a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39998,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/189caf02-e31a-4231-969e-38199d8810b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39709,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/ef4e00c2-507b-4329-88a7-4a467c13f935_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40522,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/825ad01e-cb0c-4664-b4b9-ce74f934eced_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45000,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/45773aad-28fa-43c6-a0e9-babd8f5a44d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52726,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/3f0c7477-4d57-4168-b4d3-f4a4777b58ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50233,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7ff651cf-3ae9-4b08-9bb3-e2b1749b9f9c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45269,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/c5b614da-d633-4468-8595-31409c690023_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c6fd0-3c5b-551b-a222-dbc47d0c9c3f/894c6fd0-3c5b-551b-a222-dbc47d0c9c3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43434,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM25YTG/2025-11-19/image/7515d88c-3cf3-46ae-a5c6-9fc8ebd6bcfb_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-14',
 'seller_name': 'Motability Operations',
 'title': 'KIA NIRO EV ESTATE 150kW 2 Nav 65kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 2 Nav 65kWh 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310319%27 HTTP/1.1" 200 None
2025-12-03 19:05:04 [astonbarclay.gb] INFO: Saving data for 117310319: {'created_time': 1764788704.99153, 'last_price_update_time': 1764788704.991541, 'auction_closing_time': 1765792800.0}
2025-12-03 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117310319') HTTP/1.1" 204 0
2025-12-03 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7da310>
2025-12-03 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ19WHB%252F2025-12-03%252Fimage%252Fa7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59580356-6ce9-56c0-9850-4ca232a91aa9
2025-12-03 19:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59580356-6ce9-56c0-9850-4ca232a91aa9, skipping ID generation
2025-12-03 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59580356-6ce9-56c0-9850-4ca232a91aa9 with scrape type 1
2025-12-03 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59580356-6ce9-56c0-9850-4ca232a91aa9 from tracking dictionaries
2025-12-03 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59580356-6ce9-56c0-9850-4ca232a91aa9 sending to next pipeline
2025-12-03 19:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 59580356-6ce9-56c0-9850-4ca232a91aa9, identifier: 117623718
2025-12-03 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/aee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 59580356-6ce9-56c0-9850-4ca232a91aa9 with identifier: 117623718
2025-12-03 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 59580356-6ce9-56c0-9850-4ca232a91aa9 with identifier: 117623718
2025-12-03 19:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 59580356-6ce9-56c0-9850-4ca232a91aa9 with identifier: 117623718 to the API
2025-12-03 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '59580356-6ce9-56c0-9850-4ca232a91aa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LJ19WHB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623718',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 67000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39705,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/b2613e41-41ba-4e6d-a6d8-1665bced0ecb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39325,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/86a07a78-7cda-4536-b28c-10ac57e779d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37831,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/564bf441-2bbb-4282-87d4-d52a4c7703f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35878,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/a7736c10-e2b1-471a-a432-896ecafd17c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/0cdc9302-de16-4165-abae-c9aa959ddf19_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51917,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6d451513-f07f-4a1e-85f3-e739c5e55fe8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43102,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/6e37653a-1e3b-4812-a81f-3469747280a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41767,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/8220c218-9c99-480c-812a-92da897c645b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39880,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1fe9143-5af9-478b-b023-72b87c1e0eb4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34335,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/e4674d3e-d496-4996-89d9-4a61b8659a38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53229,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/cb54ed33-ad43-45a7-bcb3-db58fef54908_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59580356-6ce9-56c0-9850-4ca232a91aa9/59580356-6ce9-56c0-9850-4ca232a91aa9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54141,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LJ19WHB/2025-12-03/image/d1a7a3e5-7ce5-4154-b339-8f75fe235a96_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-09',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 1 SERIES HATCHBACK 120i [2.0] M Sport 3dr [Nav/Servotronic] '
          'Step Auto',
 'transmission': 'automatic',
 'trim': '120i [2.0] M Sport 3dr [Nav/Servotronic] Step Auto',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623718%27 HTTP/1.1" 200 None
2025-12-03 19:05:06 [astonbarclay.gb] INFO: Saving data for 117623718: {'created_time': 1764788706.716914, 'last_price_update_time': 1764788706.716923, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623718') HTTP/1.1" 204 0
2025-12-03 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edb7110>
2025-12-03 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV18ZDX%252F2025-12-03%252Fimage%252F39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2f984c8-b200-57f6-aef0-ce4a176efcf9
2025-12-03 19:05:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2f984c8-b200-57f6-aef0-ce4a176efcf9, skipping ID generation
2025-12-03 19:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f984c8-b200-57f6-aef0-ce4a176efcf9 with scrape type 1
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2f984c8-b200-57f6-aef0-ce4a176efcf9 from tracking dictionaries
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2f984c8-b200-57f6-aef0-ce4a176efcf9 sending to next pipeline
2025-12-03 19:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b2f984c8-b200-57f6-aef0-ce4a176efcf9, identifier: 117613308
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb27690>
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eadee50>
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117732515?view=catalogue)
2025-12-03 19:05:07 [scrapy.extensions.logstats] INFO: Crawled 187 pages (at 9 pages/min), scraped 118 items (at 19 items/min)
2025-12-03 19:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b2f984c8-b200-57f6-aef0-ce4a176efcf9 with identifier: 117613308
2025-12-03 19:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b2f984c8-b200-57f6-aef0-ce4a176efcf9 with identifier: 117613308
2025-12-03 19:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b2f984c8-b200-57f6-aef0-ce4a176efcf9 with identifier: 117613308 to the API
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b2f984c8-b200-57f6-aef0-ce4a176efcf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV18ZDX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117613308',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLE DIESEL ESTATE',
 'odometer': 43006,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43064,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/aa3ff87d-bc8a-4a97-aec8-6acb1362400b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44565,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/2a152848-d6ad-4ff6-8ed1-b428bcc46da7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46545,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/d9a2005d-caca-4fa9-81c0-5529d301e0be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39547,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/3f92bed6-cc75-481d-9dc3-4ab5ac913f2a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58577,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/bd3b01ff-fdb5-42fe-a6bf-dbf189377bce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51964,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/23a16654-34da-41cd-b588-920963105f8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45441,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/224cc11d-10f9-45b0-80e4-76528d3caaea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60118,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/a56cc8bc-e209-44e7-826a-459b9dca286e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51688,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/f4f47898-f650-48bc-98b1-46686044a593_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f984c8-b200-57f6-aef0-ce4a176efcf9/b2f984c8-b200-57f6-aef0-ce4a176efcf9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51730,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV18ZDX/2025-12-03/image/39f52ec1-4455-4e81-a684-0264197c2b97_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLE DIESEL ESTATE GLE 250d 4Matic AMG Night Ed Prem + '
          '5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLE 250d 4Matic AMG Night Ed Prem + 5dr 9G-Tronic',
 'vin': None,
 'year': 2018}
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613308%27 HTTP/1.1" 200 None
2025-12-03 19:05:08 [astonbarclay.gb] INFO: Saving data for 117613308: {'created_time': 1764788708.025495, 'last_price_update_time': 1764788708.025504, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117613308') HTTP/1.1" 204 0
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed45d50>
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb99310>
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb98050>
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO71NTF%252F2025-12-03%252Fimage%252F13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fe21f96-534d-5915-9dec-cecc64a99390
2025-12-03 19:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fe21f96-534d-5915-9dec-cecc64a99390, skipping ID generation
2025-12-03 19:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe21f96-534d-5915-9dec-cecc64a99390 with scrape type 1
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1fe21f96-534d-5915-9dec-cecc64a99390 from tracking dictionaries
2025-12-03 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fe21f96-534d-5915-9dec-cecc64a99390 sending to next pipeline
2025-12-03 19:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1fe21f96-534d-5915-9dec-cecc64a99390, identifier: 117699895
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec1fe10>
2025-12-03 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF68PLV%252F2025-12-03%252Fimage%252Fcfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF68PLV/2025-12-03/image/cfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94106acc-7406-594d-9ab0-82c8bfa49099
2025-12-03 19:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94106acc-7406-594d-9ab0-82c8bfa49099, skipping ID generation
2025-12-03 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94106acc-7406-594d-9ab0-82c8bfa49099 with scrape type 1
2025-12-03 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 94106acc-7406-594d-9ab0-82c8bfa49099 from tracking dictionaries
2025-12-03 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94106acc-7406-594d-9ab0-82c8bfa49099 sending to next pipeline
2025-12-03 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 94106acc-7406-594d-9ab0-82c8bfa49099, identifier: 117624796
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117621861?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1fe21f96-534d-5915-9dec-cecc64a99390 with identifier: 117699895
2025-12-03 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1fe21f96-534d-5915-9dec-cecc64a99390 with identifier: 117699895
2025-12-03 19:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1fe21f96-534d-5915-9dec-cecc64a99390 with identifier: 117699895 to the API
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1fe21f96-534d-5915-9dec-cecc64a99390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO71NTF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117699895',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK SPECIAL EDITIONS',
 'odometer': 53499,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39595,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/21aa1099-1355-49a7-8fc6-ba7108e42216_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42493,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/565d5218-d122-4fd8-91c3-72de93f6fe6f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39685,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/94fa7b19-cefe-47a1-b3a4-86f70c876274_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41909,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/0cd6403d-5f4c-4dca-a9eb-fc50d80d7374_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/efa96f3b-88b2-47a3-8756-bf671b605a1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/7cf1af21-04c2-482a-9122-f74843caeb9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/8b17d388-6c60-4c94-8165-caca11443101_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/1eaf5c42-7869-4d62-b873-576e5b93433e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39215,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/59e69c1c-e948-4fa7-9db0-0dbc42a1dfe1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe21f96-534d-5915-9dec-cecc64a99390/1fe21f96-534d-5915-9dec-cecc64a99390_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45222,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO71NTF/2025-12-03/image/13f63611-517d-4504-992e-b1da1b3b6bcd_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seller_name': 'UKCGR - Premium',
 'title': 'NISSAN QASHQAI HATCHBACK SPECIAL EDITIONS 1.3 DiG-T MH Premiere '
          'Edition 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Premiere Edition 5dr',
 'vin': None,
 'year': 2021}
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699895%27 HTTP/1.1" 200 None
2025-12-03 19:05:09 [astonbarclay.gb] INFO: Saving data for 117699895: {'created_time': 1764788709.670512, 'last_price_update_time': 1764788709.670521, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117699895') HTTP/1.1" 204 0
2025-12-03 19:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 94106acc-7406-594d-9ab0-82c8bfa49099 with identifier: 117624796
2025-12-03 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 94106acc-7406-594d-9ab0-82c8bfa49099 with identifier: 117624796
2025-12-03 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183152 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183152
2025-12-03 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 94106acc-7406-594d-9ab0-82c8bfa49099 spider: astonbarclay.gb
2025-12-03 19:05:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 94106acc-7406-594d-9ab0-82c8bfa49099 due to rule: high_mileage_for_country.json, error: 183152 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183152
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '94106acc-7406-594d-9ab0-82c8bfa49099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KF68PLV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117624796',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 DIESEL SPORTBACK',
 'odometer': 113806,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37864,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/baca2bdd-01c4-4d8f-a31d-a51756192792_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36082,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/29eb4fcf-e626-4fe0-8170-ef43b8f14c3e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40890,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/0ccd8d14-0de5-493f-9f38-7ada62f14ee1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36649,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/80b07fd5-a20a-440e-ac18-75d1a32194cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38450,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/4f736446-0da3-4117-9008-cb50a2936165_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38024,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/2f206aa2-efc7-4d19-836f-e77bdfeee5dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37763,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/cfa08385-0a3a-4ac4-8b00-4c3b2f699728_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48296,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/5969fc79-c5a2-4179-ba0a-16a7b054d3ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47567,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/f4f5b2d5-1736-499d-a8f6-f68e39d9620d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94106acc-7406-594d-9ab0-82c8bfa49099/94106acc-7406-594d-9ab0-82c8bfa49099_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54014,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF68PLV/2025-12-03/image/c3bf9a34-5aaf-45ba-bdeb-526b9ab19d6f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'AUDI A3 DIESEL SPORTBACK 30 TDI 116 S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '30 TDI 116 S Line 5dr S Tronic',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117624796%27 HTTP/1.1" 200 None
2025-12-03 19:05:09 [astonbarclay.gb] INFO: Saving data for 117624796: {'created_time': 1764788709.932933, 'last_price_update_time': 1764788709.932942, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117624796') HTTP/1.1" 204 0
2025-12-03 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edf05d0>
2025-12-03 19:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19OVH%252F2025-12-03%252Fimage%252F7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19OVH/2025-12-03/image/7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0996638b-5f37-5acd-9186-f75da5582b20
2025-12-03 19:05:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0996638b-5f37-5acd-9186-f75da5582b20, skipping ID generation
2025-12-03 19:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0996638b-5f37-5acd-9186-f75da5582b20 with scrape type 1
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0996638b-5f37-5acd-9186-f75da5582b20 from tracking dictionaries
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0996638b-5f37-5acd-9186-f75da5582b20 sending to next pipeline
2025-12-03 19:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0996638b-5f37-5acd-9186-f75da5582b20, identifier: 117695935
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee67c10>
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252Faee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/aee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebdec90>
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252Fd84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/b1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252Fd9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0996638b-5f37-5acd-9186-f75da5582b20 with identifier: 117695935
2025-12-03 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0996638b-5f37-5acd-9186-f75da5582b20 with identifier: 117695935
2025-12-03 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144805 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144805
2025-12-03 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 0996638b-5f37-5acd-9186-f75da5582b20 spider: astonbarclay.gb
2025-12-03 19:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0996638b-5f37-5acd-9186-f75da5582b20 due to rule: high_mileage_for_make.json, error: 144805 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144805
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0996638b-5f37-5acd-9186-f75da5582b20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET19OVH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117695935',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '500X HATCHBACK',
 'odometer': 89978,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37812,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/a9c7b5bf-ea30-4526-b5c5-f6328d6873ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39009,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/7c4a35c9-5efe-4640-93ca-bfd2690ecb50_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35442,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/cc85154d-4b23-473a-af6f-e99777ca0279_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/17bb8466-443a-4951-813e-d562ea7052a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43341,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/815b2c25-a020-4440-ac8b-d84b37209fdc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55389,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/31ab7809-11e7-4d17-98e9-ff5b45c038a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47956,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/4c94568d-b3a4-41c5-adb2-3acfc892db5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51556,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/e47a6e68-d9b5-4855-84af-332b39dfc2f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53284,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/0a3633e8-8231-4643-acc5-0877f1ac9813_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55071,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/3001c627-b13a-460a-a8e4-1471ab6f0229_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0996638b-5f37-5acd-9186-f75da5582b20/0996638b-5f37-5acd-9186-f75da5582b20_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70212,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/ET19OVH/2025-12-03/image/d9f76e79-aba1-48cc-b8fd-35350e928e90_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-24',
 'seller_name': 'UKCGR - Premium',
 'title': 'FIAT 500X HATCHBACK 1.0 Cross Plus 5dr',
 'transmission': 'manual',
 'trim': '1.0 Cross Plus 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695935%27 HTTP/1.1" 200 None
2025-12-03 19:05:11 [astonbarclay.gb] INFO: Saving data for 117695935: {'created_time': 1764788711.072394, 'last_price_update_time': 1764788711.072404, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117695935') HTTP/1.1" 204 0
2025-12-03 19:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117689641?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f9d79d0>
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN19POV%252F2025-12-03%252Fimage%252F53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72
2025-12-03 19:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24c88df8-5c65-5f82-9c0b-6f2cadca5f72, skipping ID generation
2025-12-03 19:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 with scrape type 1
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 from tracking dictionaries
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 sending to next pipeline
2025-12-03 19:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 24c88df8-5c65-5f82-9c0b-6f2cadca5f72, identifier: 117732515
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee95d90>
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff46d50>
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:05:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117434122, 'registration': 'LG24WCK', 'account': 'MOT071', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '218i [136] M Sport 4dr DCT', 'mileage': 19870, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1499, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LG24WCK/2025-11-24/image/24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/c2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/f7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/fa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/da2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 9K - 06/25 9K - 08/25 17K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d66196f0-3be2-4c7f-85d6-778650b183fc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117434122, 'registration': 'LG24WCK', 'account': 'MOT071', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '218i [136] M Sport 4dr DCT', 'mileage': 19870, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1499, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LG24WCK/2025-11-24/image/24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/c2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/f7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/fa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/da2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 9K - 06/25 9K - 08/25 17K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d66196f0-3be2-4c7f-85d6-778650b183fc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bff6390-5aac-5108-95cb-36a7926e3ccb with identifier: 117434122
2025-12-03 19:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bff6390-5aac-5108-95cb-36a7926e3ccb with scrape type 1
2025-12-03 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117699816, 'registration': 'EX69DKJ', 'account': 'WBA002', 'make': 'LEXUS', 'model': 'NX ESTATE', 'derivative': '300h 2.5 F-Sport 5dr CVT [Premium Pack/Leather]', 'mileage': 24935, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-07', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-19', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/d4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/10189511-e150-4e40-a349-c16aba095782_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25- 21K', 'remarks': 'VOSA STATES 10K, 15K, 17K, 21K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ba614aa-a958-43bf-8803-ba4403e31b2b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117699816, 'registration': 'EX69DKJ', 'account': 'WBA002', 'make': 'LEXUS', 'model': 'NX ESTATE', 'derivative': '300h 2.5 F-Sport 5dr CVT [Premium Pack/Leather]', 'mileage': 24935, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-07', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-19', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/d4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/10189511-e150-4e40-a349-c16aba095782_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25- 21K', 'remarks': 'VOSA STATES 10K, 15K, 17K, 21K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ba614aa-a958-43bf-8803-ba4403e31b2b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 220e044f-9488-53a3-abe3-082bdc9668e8 with identifier: 117699816
2025-12-03 19:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220e044f-9488-53a3-abe3-082bdc9668e8 with scrape type 1
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117621861, 'registration': 'EY21BBJ', 'account': 'ALL023', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr', 'mileage': 29937, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-03-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2c5f6074-7bfe-480e-b69e-abefbed8c759.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117621861, 'registration': 'EY21BBJ', 'account': 'ALL023', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr', 'mileage': 29937, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-03-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2c5f6074-7bfe-480e-b69e-abefbed8c759.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 022f4459-138e-56ac-bed1-c073f404c876 with identifier: 117621861
2025-12-03 19:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 022f4459-138e-56ac-bed1-c073f404c876 with scrape type 1
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 022f4459-138e-56ac-bed1-c073f404c876
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 022f4459-138e-56ac-bed1-c073f404c876
2025-12-03 19:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 022f4459-138e-56ac-bed1-c073f404c876, identifier: 117621861
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117358574, 'registration': 'EO24NUP', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 10260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO24NUP/2025-11-20/image/dd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/a7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/25 6K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b2474f3-845f-4d3a-91c3-343f000bc431.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117358574, 'registration': 'EO24NUP', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 10260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO24NUP/2025-11-20/image/dd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/a7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/25 6K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b2474f3-845f-4d3a-91c3-343f000bc431.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1224a4a-fc3e-54a9-8bca-355b5b035776 with identifier: 117358574
2025-12-03 19:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1224a4a-fc3e-54a9-8bca-355b5b035776 with scrape type 1
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252Fdd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/dd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117429220, 'registration': 'LA74XYV', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr DCT', 'mileage': 1, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA74XYV/2025-11-25/image/baf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/ae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/f6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/da10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/c7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdb40533-25c9-41b4-b96d-41ebfc38d07a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117429220, 'registration': 'LA74XYV', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr DCT', 'mileage': 1, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA74XYV/2025-11-25/image/baf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/ae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/f6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/da10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/c7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdb40533-25c9-41b4-b96d-41ebfc38d07a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbb63f65-cf7c-580d-92a3-f87cf091f797 with identifier: 117429220
2025-12-03 19:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb63f65-cf7c-580d-92a3-f87cf091f797 with scrape type 1
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fbaf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/baf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 with identifier: 117732515
2025-12-03 19:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 with identifier: 117732515
2025-12-03 19:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 24c88df8-5c65-5f82-9c0b-6f2cadca5f72 with identifier: 117732515 to the API
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '24c88df8-5c65-5f82-9c0b-6f2cadca5f72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN19POV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117732515',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 42777,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42030,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/6ab3802e-0ebe-4d59-b2e3-862c950f379f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42100,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/afdfea98-55d1-4449-ba17-115661bacda5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44275,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/c0dac749-ebb5-4146-acea-ad9738abc267_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42504,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/79f54a61-b5a0-4235-9b2e-1a211531e48e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36154,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/e4b6ba26-b808-42a7-9421-3646bef23685_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55402,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/6714cfd2-9148-49ed-a8e4-542cd8f305d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52038,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/173d73ce-ea74-4709-9ff8-cd9b0b38e267_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48314,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/aee03967-ca46-486b-8b0a-19c01e629a55_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c88df8-5c65-5f82-9c0b-6f2cadca5f72/24c88df8-5c65-5f82-9c0b-6f2cadca5f72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41292,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN19POV/2025-12-03/image/53367616-836c-4b4a-9b62-413b3b144194_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-30',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A200 AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A200 AMG Line 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117732515%27 HTTP/1.1" 200 None
2025-12-03 19:05:12 [astonbarclay.gb] INFO: Saving data for 117732515: {'created_time': 1764788712.51645, 'last_price_update_time': 1764788712.516459}
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117732515') HTTP/1.1" 204 0
2025-12-03 19:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 022f4459-138e-56ac-bed1-c073f404c876 with identifier: 117621861
2025-12-03 19:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 022f4459-138e-56ac-bed1-c073f404c876 with identifier: 117621861
2025-12-03 19:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 022f4459-138e-56ac-bed1-c073f404c876 with identifier: 117621861 to the API
2025-12-03 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27022f4459-138e-56ac-bed1-c073f404c876%27 HTTP/1.1" 200 None
2025-12-03 19:05:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 022f4459-138e-56ac-bed1-c073f404c876: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:05:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117621861?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '022f4459-138e-56ac-bed1-c073f404c876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY21BBJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117621861',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 29937,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seller_name': 'SMC GROUP',
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.0 DiG-T 114 N-Connecta 5dr',
 'vin': None,
 'year': 2021}
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621861%27 HTTP/1.1" 200 None
2025-12-03 19:05:13 [astonbarclay.gb] INFO: Saving data for 117621861: {'created_time': 1764788713.63683, 'last_price_update_time': 1764788713.63684, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117621861') HTTP/1.1" 204 0
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eeb61d0>
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579304?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609437?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681911?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed0eed0>
2025-12-03 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252Fb1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/b1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed9dd90>
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117571999?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117689641, 'registration': 'GF16EPP', 'account': 'ESS030', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 3dr', 'mileage': 56441, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-04', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117689641, 'registration': 'GF16EPP', 'account': 'ESS030', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 3dr', 'mileage': 56441, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-04', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 824400f5-8ee9-5037-a271-4555c4f39381 with identifier: 117689641
2025-12-03 19:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 824400f5-8ee9-5037-a271-4555c4f39381 with scrape type 1
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 824400f5-8ee9-5037-a271-4555c4f39381
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 824400f5-8ee9-5037-a271-4555c4f39381
2025-12-03 19:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 824400f5-8ee9-5037-a271-4555c4f39381, identifier: 117689641
2025-12-03 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117635166?view=catalogue)
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252Fd4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/d4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/ae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 824400f5-8ee9-5037-a271-4555c4f39381 with identifier: 117689641
2025-12-03 19:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 824400f5-8ee9-5037-a271-4555c4f39381 with identifier: 117689641
2025-12-03 19:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 824400f5-8ee9-5037-a271-4555c4f39381 with identifier: 117689641 to the API
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27824400f5-8ee9-5037-a271-4555c4f39381%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 824400f5-8ee9-5037-a271-4555c4f39381: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:05:14 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117689641?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '824400f5-8ee9-5037-a271-4555c4f39381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF16EPP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117689641',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 56441,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'SMC GROUP',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec 3dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117689641%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [astonbarclay.gb] INFO: Saving data for 117689641: {'created_time': 1764788714.834096, 'last_price_update_time': 1764788714.834105, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117689641') HTTP/1.1" 204 0
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252Fa01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/a01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cbfa190>
2025-12-03 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252F5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee30cd0>
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM70MRU%252F2025-12-03%252Fimage%252Fd59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92df268c-e093-5a2a-b3ca-abd702a89640
2025-12-03 19:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92df268c-e093-5a2a-b3ca-abd702a89640, skipping ID generation
2025-12-03 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92df268c-e093-5a2a-b3ca-abd702a89640 with scrape type 1
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 92df268c-e093-5a2a-b3ca-abd702a89640 from tracking dictionaries
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92df268c-e093-5a2a-b3ca-abd702a89640 sending to next pipeline
2025-12-03 19:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92df268c-e093-5a2a-b3ca-abd702a89640, identifier: 117579304
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec24d90>
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119c157bd0>
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWG71JZW%252F2025-12-03%252Fimage%252F543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 343205af-8224-572b-a93f-7342725c54cc
2025-12-03 19:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 343205af-8224-572b-a93f-7342725c54cc, skipping ID generation
2025-12-03 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343205af-8224-572b-a93f-7342725c54cc with scrape type 1
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 343205af-8224-572b-a93f-7342725c54cc from tracking dictionaries
2025-12-03 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 343205af-8224-572b-a93f-7342725c54cc sending to next pipeline
2025-12-03 19:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 343205af-8224-572b-a93f-7342725c54cc, identifier: 117609437
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8c8310>
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f74be10>
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eda66d0>
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFR03PKR%252F2025-12-02%252Fimage%252F6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e934fa08-d17b-5354-aa22-1c0dc470571a
2025-12-03 19:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e934fa08-d17b-5354-aa22-1c0dc470571a, skipping ID generation
2025-12-03 19:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e934fa08-d17b-5354-aa22-1c0dc470571a with scrape type 1
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e934fa08-d17b-5354-aa22-1c0dc470571a from tracking dictionaries
2025-12-03 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e934fa08-d17b-5354-aa22-1c0dc470571a sending to next pipeline
2025-12-03 19:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e934fa08-d17b-5354-aa22-1c0dc470571a, identifier: 117681911
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e43c8d0>
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f80df50>
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg?w=600 saved to cache
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/dd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/bf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/baf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740684?view=catalogue)
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Ff6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/f6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92df268c-e093-5a2a-b3ca-abd702a89640 with identifier: 117579304
2025-12-03 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92df268c-e093-5a2a-b3ca-abd702a89640 with identifier: 117579304
2025-12-03 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 13, 'seller_name': 'weflex', 'price_includes_vat': False, 'title': 'kia e-niro electric estate 150kw 4 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'e-niro electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 160680, 'odometer_reading_unit': 'mi', 'registration_date': '2020-10-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579304', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '150kw 4 64kwh 5dr auto', 'license_plate': 'lm70mru', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '92df268c-e093-5a2a-b3ca-abd702a89640', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34766}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35547}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32926}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49191}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59306}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45299}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47176}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 54553}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55268}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 55459}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_12.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 65102}], 'current_year_diff': 5, 'age_in_months': 61, 'make_model': 'kia e-niro electric estate', 'sanitized_make': 'kia', 'odometer_in_km': 258588}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '92df268c-e093-5a2a-b3ca-abd702a89640',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'lm70mru',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579304',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'kia',
     'make_model': 'kia e-niro electric estate',
     'model': 'e-niro electric estate',
     'odometer': 160680,
     'odometer_in_km': 258588,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33482,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34766,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35547,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32926,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49191,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59306,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45299,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47176,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54553,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55013,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55268,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55459,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65102,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-19',
     'sanitized_make': 'kia',
     'seller_name': 'weflex',
     'title': 'kia e-niro electric estate 150kw 4 64kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 4 64kwh 5dr auto',
     'vin': None,
     'year': 2020}
2025-12-03 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 92df268c-e093-5a2a-b3ca-abd702a89640 spider: astonbarclay.gb
2025-12-03 19:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 92df268c-e093-5a2a-b3ca-abd702a89640 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 13, 'seller_name': 'weflex', 'price_includes_vat': False, 'title': 'kia e-niro electric estate 150kw 4 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'e-niro electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 160680, 'odometer_reading_unit': 'mi', 'registration_date': '2020-10-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579304', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '150kw 4 64kwh 5dr auto', 'license_plate': 'lm70mru', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '92df268c-e093-5a2a-b3ca-abd702a89640', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34766}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35547}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32926}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49191}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59306}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45299}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47176}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 54553}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55268}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_11.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 55459}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_12.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 65102}], 'current_year_diff': 5, 'age_in_months': 61, 'make_model': 'kia e-niro electric estate', 'sanitized_make': 'kia', 'odometer_in_km': 258588}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '92df268c-e093-5a2a-b3ca-abd702a89640',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'lm70mru',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579304',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'kia',
     'make_model': 'kia e-niro electric estate',
     'model': 'e-niro electric estate',
     'odometer': 160680,
     'odometer_in_km': 258588,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33482,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34766,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35547,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32926,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49191,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59306,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45299,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47176,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54553,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55013,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55268,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55459,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65102,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-19',
     'sanitized_make': 'kia',
     'seller_name': 'weflex',
     'title': 'kia e-niro electric estate 150kw 4 64kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 4 64kwh 5dr auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '92df268c-e093-5a2a-b3ca-abd702a89640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LM70MRU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579304',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'E-NIRO ELECTRIC ESTATE',
 'odometer': 160680,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33482,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/5adfc132-3f41-46fb-98b8-f988d2a106a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34766,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d59d0e15-803b-4775-abdb-be124bcb7124_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35547,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0ce37c60-0fbf-4d5e-aa78-fb2485cebb99_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32926,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/875f4c70-7630-4820-af71-c700f4258bf3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49191,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/88575d40-fd4a-4fe9-bee5-7d75baf19eb1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59306,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/4855c88e-89bb-4299-8d79-5ae076777bcf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45299,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0372b746-1800-4ffb-9669-684e1ce3ccb2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47176,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/d6d0d8de-22ce-4322-bf85-b2379a1416f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54553,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/c2141e33-dd98-43c2-ad41-ba58335189f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55013,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/0b70e554-0160-42d6-84d9-af6e66b737b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55268,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/f2931961-33f3-41eb-b234-39affc60a889_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55459,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/02b85fad-f3a3-467a-b31b-64cd9769c951_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92df268c-e093-5a2a-b3ca-abd702a89640/92df268c-e093-5a2a-b3ca-abd702a89640_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65102,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LM70MRU/2025-12-03/image/2cee48a9-1d68-46e8-98c1-daf1c0a7a3c7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-19',
 'seller_name': 'WeFlex',
 'title': 'KIA E-NIRO ELECTRIC ESTATE 150kW 4 64kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 4 64kWh 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579304%27 HTTP/1.1" 200 None
2025-12-03 19:05:17 [astonbarclay.gb] INFO: Saving data for 117579304: {'created_time': 1764788717.826537, 'last_price_update_time': 1764788717.826547, 'auction_closing_time': 1765188000.0}
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579304') HTTP/1.1" 204 0
2025-12-03 19:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 343205af-8224-572b-a93f-7342725c54cc with identifier: 117609437
2025-12-03 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 343205af-8224-572b-a93f-7342725c54cc with identifier: 117609437
2025-12-03 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 10, 'seller_name': 'days fleet', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 64079, 'odometer_reading_unit': 'mi', 'registration_date': '2022-01-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609437', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw sport 80kwh 5dr auto', 'license_plate': 'wg71jzw', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '343205af-8224-572b-a93f-7342725c54cc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 29804}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 34574}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 32914}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 33409}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 73526}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 86624}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 56169}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 51270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 12520}], 'current_year_diff': 3, 'age_in_months': 46, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 103124} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '343205af-8224-572b-a93f-7342725c54cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'wg71jzw',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609437',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 64079,
     'odometer_in_km': 103124,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29804,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34574,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32914,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33409,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48500,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73526,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86624,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56169,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51270,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 12520,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-01-19',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'days fleet',
     'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw sport 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-03 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 343205af-8224-572b-a93f-7342725c54cc spider: astonbarclay.gb
2025-12-03 19:05:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 343205af-8224-572b-a93f-7342725c54cc due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 10, 'seller_name': 'days fleet', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 64079, 'odometer_reading_unit': 'mi', 'registration_date': '2022-01-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609437', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw sport 80kwh 5dr auto', 'license_plate': 'wg71jzw', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '343205af-8224-572b-a93f-7342725c54cc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 29804}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 34574}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 32914}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 33409}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 73526}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600', 'Width': 600, 'Height': 960, 'Extension': 'jpg', 'FileSizeInBytes': 86624}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 56169}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 51270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 12520}], 'current_year_diff': 3, 'age_in_months': 46, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 103124} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '343205af-8224-572b-a93f-7342725c54cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'wg71jzw',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609437',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 64079,
     'odometer_in_km': 103124,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29804,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34574,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32914,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33409,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48500,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73526,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86624,
                 'Height': 960,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56169,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51270,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 12520,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-01-19',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'days fleet',
     'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw sport 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '343205af-8224-572b-a93f-7342725c54cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WG71JZW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609437',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 64079,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29804,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/543072a4-bb6e-40dc-b596-67876295a4cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34574,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/0a992adb-917f-49ad-9f6b-285fa52d19b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32914,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7e9ea5f0-53bc-47b2-90ca-f4ab522ed8a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33409,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/7b66b60b-b4b2-41d3-b758-bee959419807_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48500,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/1d53a339-6548-457a-a1a3-37b581fac74c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73526,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/5bcd07b8-fc94-4f61-b9e2-a3918747daa9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86624,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/4dc7ebc8-0cee-4b5f-baa9-1d78071e6254_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56169,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/a026c8af-abf2-4bcc-8165-74290f78c3f6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51270,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/de988243-d4a8-44b0-9ad6-24c8f0b6aac7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343205af-8224-572b-a93f-7342725c54cc/343205af-8224-572b-a93f-7342725c54cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 12520,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/WG71JZW/2025-12-03/image/2dcb3339-6e9c-4780-b177-d587dcbf7b1c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seller_name': 'Days Fleet',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW Sport 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW Sport 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609437%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [astonbarclay.gb] INFO: Saving data for 117609437: {'created_time': 1764788718.063691, 'last_price_update_time': 1764788718.0637, 'auction_closing_time': 1765188000.0}
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117609437') HTTP/1.1" 204 0
2025-12-03 19:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e934fa08-d17b-5354-aa22-1c0dc470571a with identifier: 117681911
2025-12-03 19:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e934fa08-d17b-5354-aa22-1c0dc470571a with identifier: 117681911
2025-12-03 19:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e934fa08-d17b-5354-aa22-1c0dc470571a with identifier: 117681911 to the API
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e934fa08-d17b-5354-aa22-1c0dc470571a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FR03PKR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681911',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'IBIZA HATCHBACK',
 'odometer': 88127,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39775,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/900ebf16-5504-41a0-a46b-a04c6f6782f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42435,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/6dd4b181-9ab0-4c12-8c78-e4698973c3c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36930,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/5ccb4181-e70b-4e09-8b0d-39d334e79410_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36727,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8a5182bc-861e-42ba-ad2e-987856d99b58_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53899,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/b1de77d4-ece0-49fe-bab7-37ccefb85100_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43568,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/23be0c9b-782e-4153-817d-b64847af0a7c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40825,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8bee7fec-ba39-4ed3-96b0-de0e6fb63fcb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52413,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/8dfb3d67-8ccf-45d6-ac05-ed74d5b21fd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50258,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/403ddd77-2682-4346-aaf2-d115af84a70a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e934fa08-d17b-5354-aa22-1c0dc470571a/e934fa08-d17b-5354-aa22-1c0dc470571a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54765,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FR03PKR/2025-12-02/image/fb809544-18f1-4f86-beb5-746c6aad6048_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'SEAT IBIZA HATCHBACK 1.0 SE Technology [EZ] 5dr',
 'transmission': 'manual',
 'trim': '1.0 SE Technology [EZ] 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681911%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [astonbarclay.gb] INFO: Saving data for 117681911: {'created_time': 1764788718.433089, 'last_price_update_time': 1764788718.433098, 'auction_closing_time': 1765188000.0}
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681911') HTTP/1.1" 204 0
2025-12-03 19:05:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681445, 'registration': 'LA22CXR', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 180 AMG Line Premium 5dr Auto', 'mileage': 26493, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-07-15', 'fuel': 'Petrol', 'motExpiry': '2026-07-14', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA22CXR/2025-12-03/image/feeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/c3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/d7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aedf4576-674c-418b-ad13-21fd727def10.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681445, 'registration': 'LA22CXR', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 180 AMG Line Premium 5dr Auto', 'mileage': 26493, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 478}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-07-15', 'fuel': 'Petrol', 'motExpiry': '2026-07-14', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA22CXR/2025-12-03/image/feeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/c3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/d7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aedf4576-674c-418b-ad13-21fd727def10.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a60fbc7c-8d07-5df6-8852-594e54aa5289 with identifier: 117681445
2025-12-03 19:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a60fbc7c-8d07-5df6-8852-594e54aa5289 with scrape type 1
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Ffeeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/feeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117571999, 'registration': 'AO16UXP', 'account': 'SPR003', 'make': 'SKODA', 'model': 'CITIGO HATCHBACK', 'derivative': '1.0 MPI Monte Carlo 5dr', 'mileage': 44129, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO16UXP/2025-11-28/image/02544ac6-c73a-4bd1-96fe-5f75ddc3bb1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/1179c63a-30fc-4328-8e3b-9194a963e16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/61b1a491-9b65-40b3-8288-cc4a9e4f707d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e5780a1-8f8d-45a3-b681-32466292755b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/7fdfd29f-3c1c-4f83-9575-87de6a152b3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e79f7a0-a657-4638-9d4e-0721eff5cb44_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/c50dfbd0-3138-4d93-b848-6cfb4a88ca04_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/839b97e5-cd6e-4733-960a-d99a89d412fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/d4dc3b24-51b2-466a-b27c-283cae71b27d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/17 - 3K, 11/23 - 34K,', 'remarks': '**616**VOSA STATES 13K, 20K, 24K, 29K, 34K, 39K, 44K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7af16d40-723a-418c-b19b-95047ab6bbcd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117571999, 'registration': 'AO16UXP', 'account': 'SPR003', 'make': 'SKODA', 'model': 'CITIGO HATCHBACK', 'derivative': '1.0 MPI Monte Carlo 5dr', 'mileage': 44129, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO16UXP/2025-11-28/image/02544ac6-c73a-4bd1-96fe-5f75ddc3bb1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/1179c63a-30fc-4328-8e3b-9194a963e16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/61b1a491-9b65-40b3-8288-cc4a9e4f707d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e5780a1-8f8d-45a3-b681-32466292755b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/7fdfd29f-3c1c-4f83-9575-87de6a152b3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e79f7a0-a657-4638-9d4e-0721eff5cb44_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/c50dfbd0-3138-4d93-b848-6cfb4a88ca04_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/839b97e5-cd6e-4733-960a-d99a89d412fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/d4dc3b24-51b2-466a-b27c-283cae71b27d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/17 - 3K, 11/23 - 34K,', 'remarks': '**616**VOSA STATES 13K, 20K, 24K, 29K, 34K, 39K, 44K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7af16d40-723a-418c-b19b-95047ab6bbcd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999
2025-12-03 19:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116cf5fe-abf4-52fb-8573-3a03228655a2 with scrape type 2
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 116cf5fe-abf4-52fb-8573-3a03228655a2 with scrape type 2
2025-12-03 19:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 116cf5fe-abf4-52fb-8573-3a03228655a2, identifier: 117571999
2025-12-03 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edf9e90>
2025-12-03 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fbe2cf534-0177-43f0-9f0d-a23043756f14.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600 saved to cache
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a
2025-12-03 19:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4b7e09c-15c8-549e-bc18-af6ef5591e0a, skipping ID generation
2025-12-03 19:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a with scrape type 1
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d4b7e09c-15c8-549e-bc18-af6ef5591e0a from tracking dictionaries
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4b7e09c-15c8-549e-bc18-af6ef5591e0a sending to next pipeline
2025-12-03 19:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d4b7e09c-15c8-549e-bc18-af6ef5591e0a, identifier: 117635166
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Fc2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/c2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252Fa7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/a7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999
2025-12-03 19:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999
2025-12-03 19:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999 to the API
2025-12-03 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117571999?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '116cf5fe-abf4-52fb-8573-3a03228655a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO16UXP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571999',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'SKODA',
 'model': 'CITIGO HATCHBACK',
 'odometer': 44129,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-27',
 'seller_name': 'Ford Main Dealer',
 'title': 'SKODA CITIGO HATCHBACK 1.0 MPI Monte Carlo 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPI Monte Carlo 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571999%27 HTTP/1.1" 200 None
2025-12-03 19:05:19 [astonbarclay.gb] INFO: Saving data for 117571999: {'auction_closing_time': 1764936000.0, 'created_time': 1764356519.157809, 'last_price_update_time': 1764788719.894886}
2025-12-03 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117571999') HTTP/1.1" 204 0
2025-12-03 19:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d4b7e09c-15c8-549e-bc18-af6ef5591e0a with identifier: 117635166
2025-12-03 19:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d4b7e09c-15c8-549e-bc18-af6ef5591e0a with identifier: 117635166
2025-12-03 19:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d4b7e09c-15c8-549e-bc18-af6ef5591e0a with identifier: 117635166 to the API
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd4b7e09c-15c8-549e-bc18-af6ef5591e0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY18ZBW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635166',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLC DIESEL ESTATE',
 'odometer': 68337,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77854,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/ef282d63-2794-440d-9da2-a062793ef9cf.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73754,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/d5803044-7e49-491a-82cd-a23aedc2d502.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58704,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/3b7ecb46-1cc8-4cef-bebe-e18b8b453ed1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96162,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/a9e2d8c4-eaf0-44d2-a5c6-350be898d298.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101562,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/be2cf534-0177-43f0-9f0d-a23043756f14.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102388,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/e85a823c-df47-404e-9d9c-8d6488f054eb.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b7e09c-15c8-549e-bc18-af6ef5591e0a/d4b7e09c-15c8-549e-bc18-af6ef5591e0a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87283,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/9615059c-85bb-4a8d-a42e-de2ca9601c2e.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLC DIESEL ESTATE GLC 250d 4Matic AMG Line Premium '
          '5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 250d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'vin': None,
 'year': 2018}
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635166%27 HTTP/1.1" 200 None
2025-12-03 19:05:20 [astonbarclay.gb] INFO: Saving data for 117635166: {'created_time': 1764788720.27305, 'last_price_update_time': 1764788720.273061, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117635166') HTTP/1.1" 204 0
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fa35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585302?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7f55d0>
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252Fdd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/dd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7f77d0>
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252Fbf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/bf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f77c0d0>
2025-12-03 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb2b750>
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fbaf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/baf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edc0150>
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9ffb90>
2025-12-03 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252Fd9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea34b10>
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea5a0d0>
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23XWH%252F2025-12-03%252Fimage%252F9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0d1af40-2acf-5757-afee-5bfaa9c65465
2025-12-03 19:05:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0d1af40-2acf-5757-afee-5bfaa9c65465, skipping ID generation
2025-12-03 19:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d1af40-2acf-5757-afee-5bfaa9c65465 with scrape type 1
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c0d1af40-2acf-5757-afee-5bfaa9c65465 from tracking dictionaries
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0d1af40-2acf-5757-afee-5bfaa9c65465 sending to next pipeline
2025-12-03 19:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c0d1af40-2acf-5757-afee-5bfaa9c65465, identifier: 117740684
2025-12-03 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/d4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/ae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fa5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c0d1af40-2acf-5757-afee-5bfaa9c65465 with identifier: 117740684
2025-12-03 19:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c0d1af40-2acf-5757-afee-5bfaa9c65465 with identifier: 117740684
2025-12-03 19:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c0d1af40-2acf-5757-afee-5bfaa9c65465 with identifier: 117740684 to the API
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c0d1af40-2acf-5757-afee-5bfaa9c65465',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23XWH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117740684',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 20489,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26455,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/bf5d2d63-02ae-4f7c-864e-eab3600a7777_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24371,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/9eab9bfe-7bd4-48ce-9b47-73d1f83630fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26504,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a4dc7c1d-977b-48e0-a080-5872ffe50654_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25072,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/a9885cb8-678f-4edb-8acb-93d314a6b195_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38560,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/8d2f7c20-3da7-48ae-a94b-70415c1cfd26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85722,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/dedd8935-08a1-4124-8976-7a32765fe009_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73131,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/c8b89080-dec0-4ef0-bbbb-1b9aea88b8c6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45719,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/016a894c-bb40-4f62-9499-884b49cab280_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d1af40-2acf-5757-afee-5bfaa9c65465/c0d1af40-2acf-5757-afee-5bfaa9c65465_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39378,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DF23XWH/2025-12-03/image/0731e005-8b00-4a75-a250-69a3c0cfd9d4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-03 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740684%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [astonbarclay.gb] INFO: Saving data for 117740684: {'created_time': 1764788723.112918, 'last_price_update_time': 1764788723.11293, 'auction_closing_time': 1765188000.0}
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117740684') HTTP/1.1" 204 0
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/a01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Ff7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/f7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252Fbc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252Fead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117711420?view=catalogue)
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252F174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117721727?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Ffa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/fa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fde6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edb6cd0>
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eab47d0>
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f772610>
2025-12-03 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117585302, 'registration': 'MK66YOH', 'account': 'DJC008', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi N-Vision 5dr', 'mileage': 105048, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-20', 'fuel': 'Diesel', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/MK66YOH/2025-12-02/image/d71ff9ae-d99b-4e31-8f0b-105e635e8054_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/267cc466-cc36-41ff-b388-2ff477df91f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/2aa407ac-99e1-4a1c-b749-a6ad62266acb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/35234459-af94-4b59-a3be-ee3fdca1371b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/3283dbb0-7888-4bea-b567-cd4115142210_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/9c537dc1-207b-4a55-859f-a173f780beba_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/5c11aef7-0ba6-4b4d-b9d6-b7929d07b870_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/fb54ec2e-faf4-4f28-87b1-45a50d496fa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/7a56716b-d85d-4dcc-a41b-6a08d4a67282_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/17 - 15K, 01/19 - 28K, 12/19 - 36K, 12/20 - 49K, 12/21 - 62K, 02/25 - 95K', 'remarks': '**1697** VOSA STATES 36K, 49K, 62K, 69K, 81K, 93K SD CARD', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9598e0-f86a-4503-9cdc-aff706cfa1d6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117585302, 'registration': 'MK66YOH', 'account': 'DJC008', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi N-Vision 5dr', 'mileage': 105048, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-20', 'fuel': 'Diesel', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/MK66YOH/2025-12-02/image/d71ff9ae-d99b-4e31-8f0b-105e635e8054_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/267cc466-cc36-41ff-b388-2ff477df91f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/2aa407ac-99e1-4a1c-b749-a6ad62266acb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/35234459-af94-4b59-a3be-ee3fdca1371b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/3283dbb0-7888-4bea-b567-cd4115142210_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/9c537dc1-207b-4a55-859f-a173f780beba_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/5c11aef7-0ba6-4b4d-b9d6-b7929d07b870_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/fb54ec2e-faf4-4f28-87b1-45a50d496fa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK66YOH/2025-12-02/image/7a56716b-d85d-4dcc-a41b-6a08d4a67282_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/17 - 15K, 01/19 - 28K, 12/19 - 36K, 12/20 - 49K, 12/21 - 62K, 02/25 - 95K', 'remarks': '**1697** VOSA STATES 36K, 49K, 62K, 69K, 81K, 93K SD CARD', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9598e0-f86a-4503-9cdc-aff706cfa1d6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with identifier: 117585302
2025-12-03 19:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with scrape type 2
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with scrape type 2
2025-12-03 19:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463, identifier: 117585302
2025-12-03 19:05:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117679523, 'registration': 'DK68NFD', 'account': 'VAN041', 'make': 'BMW', 'model': '2 SERIES ACTIVE TOURER', 'derivative': '220i SE 5dr DCT', 'mileage': 45303, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/a8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/bc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/f35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/e33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/df6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1232**VOSA STATES 16K, 20K, 26K, 37K, 44K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a28034da-e4ea-4835-938e-f7fa6ef18c8d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117679523, 'registration': 'DK68NFD', 'account': 'VAN041', 'make': 'BMW', 'model': '2 SERIES ACTIVE TOURER', 'derivative': '220i SE 5dr DCT', 'mileage': 45303, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/a8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/bc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/f35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/e33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/df6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1232**VOSA STATES 16K, 20K, 26K, 37K, 44K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a28034da-e4ea-4835-938e-f7fa6ef18c8d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a4c9d15-f349-598f-b5c8-4c228bf14146 with identifier: 117679523
2025-12-03 19:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a4c9d15-f349-598f-b5c8-4c228bf14146 with scrape type 1
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117724459, 'registration': 'PJ66EOP', 'account': 'AST058', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 S 3dr', 'mileage': 101605, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-23', 'fuel': 'Petrol', 'motExpiry': '2026-08-08', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/cfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/17 - 9K, 10/18 - 30K, 10/19 - 44K, 10/20 - 59K, 10/21 - 68K, 10/22 - 83K', 'remarks': '**1748** VOSA STATES 44K, 59K, 68K, 83K, 91K, 98K, 101K, 101K', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1fb6078d-b750-431e-a657-7e1ec2d5b4f8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117724459, 'registration': 'PJ66EOP', 'account': 'AST058', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 S 3dr', 'mileage': 101605, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-23', 'fuel': 'Petrol', 'motExpiry': '2026-08-08', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/cfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/17 - 9K, 10/18 - 30K, 10/19 - 44K, 10/20 - 59K, 10/21 - 68K, 10/22 - 83K', 'remarks': '**1748** VOSA STATES 44K, 59K, 68K, 83K, 91K, 98K, 101K, 101K', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1fb6078d-b750-431e-a657-7e1ec2d5b4f8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7062b5c-ae93-5012-8a5f-6ee8800b2a08 with identifier: 117724459
2025-12-03 19:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08 with scrape type 1
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f868550>
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252Fd4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/d4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eaf8590>
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/ae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f82bc10>
2025-12-03 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252Fa01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/a01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f771410>
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8cadd0>
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fda10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/da10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with identifier: 117585302
2025-12-03 19:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with identifier: 117585302
2025-12-03 19:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169057
2025-12-03 19:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 spider: astonbarclay.gb
2025-12-03 19:05:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 due to rule: high_mileage_for_country.json, error: 169057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169057
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MK66YOH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585302',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'X-TRAIL DIESEL STATION WAGON',
 'odometer': 105048,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': 'Cox Motor Group',
 'title': 'NISSAN X-TRAIL DIESEL STATION WAGON 1.6 dCi N-Vision 5dr',
 'transmission': 'manual',
 'trim': '1.6 dCi N-Vision 5dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585302%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [astonbarclay.gb] INFO: Saving data for 117585302: {'auction_closing_time': 1764936000.0, 'created_time': 1764615632.327101, 'last_price_update_time': 1764788725.862929}
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585302') HTTP/1.1" 204 0
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/a7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252F99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Fda2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/da2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F10189511-e150-4e40-a349-c16aba095782_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/10189511-e150-4e40-a349-c16aba095782_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fc7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/c7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed9f610>
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebbacd0>
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7f6950>
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX69RWY%252F2025-12-03%252Fimage%252F4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177
2025-12-03 19:05:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3dc4eb14-9e97-519e-b237-3f47d8bc4177, skipping ID generation
2025-12-03 19:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177 with scrape type 1
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3dc4eb14-9e97-519e-b237-3f47d8bc4177 from tracking dictionaries
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3dc4eb14-9e97-519e-b237-3f47d8bc4177 sending to next pipeline
2025-12-03 19:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3dc4eb14-9e97-519e-b237-3f47d8bc4177, identifier: 117711420
2025-12-03 19:05:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117721727, 'registration': 'Y88MJA', 'account': 'LIN201', 'make': 'FORD', 'model': 'MONDEO DIESEL ESTATE', 'derivative': '2.0 TDCi 210 Titanium 5dr Powershift', 'mileage': 92163, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-04-18', 'fuel': 'Diesel', 'motExpiry': '2026-04-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 2 SERVICE BOOKS 12/16 - 8K, 07/17 - 14K, 07/18 - 25K, 03/20 - 42K, 04/22 - 57K, 04/24 - 75K', 'remarks': '**1449** VOSA STATES 31K, 42K, 49K, 57K, 67K, 75K, 86K', 'virtual': False, 'seller': 'Local Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117721727, 'registration': 'Y88MJA', 'account': 'LIN201', 'make': 'FORD', 'model': 'MONDEO DIESEL ESTATE', 'derivative': '2.0 TDCi 210 Titanium 5dr Powershift', 'mileage': 92163, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-04-18', 'fuel': 'Diesel', 'motExpiry': '2026-04-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 2 SERVICE BOOKS 12/16 - 8K, 07/17 - 14K, 07/18 - 25K, 03/20 - 42K, 04/22 - 57K, 04/24 - 75K', 'remarks': '**1449** VOSA STATES 31K, 42K, 49K, 57K, 67K, 75K, 86K', 'virtual': False, 'seller': 'Local Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da88d71-2819-589f-adf1-9cf79f45a05b with identifier: 117721727
2025-12-03 19:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da88d71-2819-589f-adf1-9cf79f45a05b with scrape type 1
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6da88d71-2819-589f-adf1-9cf79f45a05b
2025-12-03 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6da88d71-2819-589f-adf1-9cf79f45a05b
2025-12-03 19:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6da88d71-2819-589f-adf1-9cf79f45a05b, identifier: 117721727
2025-12-03 19:05:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117644920, 'registration': 'NV67CZN', 'account': 'VAN041', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Press 5dr', 'mileage': 54953, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-12', 'fuel': 'Petrol', 'motExpiry': '2026-02-18', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NV67CZN/2025-12-03/image/5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/f2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/19 - 10K, 07/20 - 21K, 03/23 - 49K', 'remarks': '**1360** VOSA STATES 29K, 38K, 49K, 52K, 53K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/999e4a2a-bda7-4007-967b-9d3f3db53229.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117644920, 'registration': 'NV67CZN', 'account': 'VAN041', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Press 5dr', 'mileage': 54953, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-12', 'fuel': 'Petrol', 'motExpiry': '2026-02-18', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NV67CZN/2025-12-03/image/5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/f2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/19 - 10K, 07/20 - 21K, 03/23 - 49K', 'remarks': '**1360** VOSA STATES 29K, 38K, 49K, 52K, 53K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/999e4a2a-bda7-4007-967b-9d3f3db53229.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c0427c3-9123-5d2d-af01-56c3912aa066 with identifier: 117644920
2025-12-03 19:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c0427c3-9123-5d2d-af01-56c3912aa066 with scrape type 1
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/f6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/feeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fa18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3dc4eb14-9e97-519e-b237-3f47d8bc4177 with identifier: 117711420
2025-12-03 19:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3dc4eb14-9e97-519e-b237-3f47d8bc4177 with identifier: 117711420
2025-12-03 19:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3dc4eb14-9e97-519e-b237-3f47d8bc4177 with identifier: 117711420 to the API
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '3dc4eb14-9e97-519e-b237-3f47d8bc4177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DX69RWY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117711420',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER ESTATE',
 'odometer': 80525,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38982,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e08c64a-2fc8-46df-b2ee-774bc87f27a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44751,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d84b6cba-176d-4f32-a347-9f80ad6855cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43230,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/2e56ebe9-6fe1-44a4-a78a-44753afa1bee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38400,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/8a41ca90-5a7e-411d-a2fa-83181864b19a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48659,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/7a9e8347-d99e-428c-9e30-5355cddf1b5e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53386,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4569a4f8-a1a9-4509-b201-9e5b3365058f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36602,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/d9b5074f-2726-4f07-b52c-5f8c9b97e7c6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53156,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/4d6b76d0-a5b8-4fa7-8834-45251b7bfac8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64481,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/3e44c7db-82f5-48f8-95bd-714899b6db22_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc4eb14-9e97-519e-b237-3f47d8bc4177/3dc4eb14-9e97-519e-b237-3f47d8bc4177_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48506,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX69RWY/2025-12-03/image/a01df8f3-2e3c-44d0-b3aa-1a890da626e4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-01',
 'seller_name': 'UKCGR',
 'title': 'MITSUBISHI OUTLANDER ESTATE 2.4 PHEV 5hs 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.4 PHEV 5hs 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117711420%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [astonbarclay.gb] INFO: Saving data for 117711420: {'created_time': 1764788727.528188, 'last_price_update_time': 1764788727.528199}
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117711420') HTTP/1.1" 204 0
2025-12-03 19:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6da88d71-2819-589f-adf1-9cf79f45a05b with identifier: 117721727
2025-12-03 19:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6da88d71-2819-589f-adf1-9cf79f45a05b with identifier: 117721727
2025-12-03 19:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6da88d71-2819-589f-adf1-9cf79f45a05b with identifier: 117721727 to the API
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276da88d71-2819-589f-adf1-9cf79f45a05b%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6da88d71-2819-589f-adf1-9cf79f45a05b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 19:05:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 19:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117721727?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6da88d71-2819-589f-adf1-9cf79f45a05b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'Y88MJA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117721727',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'MONDEO DIESEL ESTATE',
 'odometer': 92163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-18',
 'seller_name': 'Local Dealer',
 'title': 'FORD MONDEO DIESEL ESTATE 2.0 TDCi 210 Titanium 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 210 Titanium 5dr Powershift',
 'vin': None,
 'year': 2016}
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117721727%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [astonbarclay.gb] INFO: Saving data for 117721727: {'created_time': 1764788727.881399, 'last_price_update_time': 1764788727.881408, 'auction_closing_time': 1765285200.0}
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117721727') HTTP/1.1" 204 0
2025-12-03 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/c2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb1d490>
2025-12-03 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f737750>
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fa35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8d93d0>
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f84f310>
2025-12-03 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fc3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/c3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fa8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/a8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252Fcfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/cfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7ee090>
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edc6050>
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edc6e90>
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252Fa7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/a7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed4fc50>
2025-12-03 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fb4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/fa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252F1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119ce33890>
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Ff6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/f6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec3d750>
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Ffeeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/feeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f89dd90>
2025-12-03 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fa5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f8196d0>
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Fc2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/c2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/da10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fd7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/d7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca0710>
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ede5990>
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252F174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec52010>
2025-12-03 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7ec3d0>
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f813710>
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea32590>
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edae350>
2025-12-03 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252F47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edbc250>
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Ffa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/fa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/c7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Ff2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/f2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d86d0>
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca7e90>
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fda10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/da10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119e43d8d0>
2025-12-03 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d9050>
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/a8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fbc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/bc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec3fb10>
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f820510>
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252F99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119c147590>
2025-12-03 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb113d0>
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb13c10>
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb4cc90>
2025-12-03 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edad390>
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fa18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea33750>
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252Fc7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/c7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/cfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/c3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Ff35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/f35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fb0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee39f10>
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fa8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/a8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fe33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/e33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429220?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/10189511-e150-4e40-a349-c16aba095782_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/d7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fdf6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/df6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff19dd0>
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec27150>
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252Fcfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/cfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7d4e90>
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252F1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed6bdd0>
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fc3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/c3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f810810>
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd2f10>
2025-12-03 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fb4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7dbd90>
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eda6fd0>
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f829ed0>
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA74XYV%252F2025-11-25%252Fimage%252F35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cbb63f65-cf7c-580d-92a3-f87cf091f797
2025-12-03 19:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbb63f65-cf7c-580d-92a3-f87cf091f797, skipping ID generation
2025-12-03 19:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb63f65-cf7c-580d-92a3-f87cf091f797 with scrape type 1
2025-12-03 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cbb63f65-cf7c-580d-92a3-f87cf091f797 from tracking dictionaries
2025-12-03 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbb63f65-cf7c-580d-92a3-f87cf091f797 sending to next pipeline
2025-12-03 19:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbb63f65-cf7c-580d-92a3-f87cf091f797, identifier: 117429220
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff525d0>
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252F10189511-e150-4e40-a349-c16aba095782_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/10189511-e150-4e40-a349-c16aba095782_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edbdf50>
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eda5450>
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fd7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/d7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbb63f65-cf7c-580d-92a3-f87cf091f797 with identifier: 117429220
2025-12-03 19:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbb63f65-cf7c-580d-92a3-f87cf091f797 with identifier: 117429220
2025-12-03 19:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cbb63f65-cf7c-580d-92a3-f87cf091f797 with identifier: 117429220 to the API
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cbb63f65-cf7c-580d-92a3-f87cf091f797',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LA74XYV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117429220',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 1,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36843,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/baf45fc5-ac53-48f8-8abf-14cb07fe9dbf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40831,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/48944f26-7a31-409f-bb98-15ea18cfa5de_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38514,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/ae376ab4-769c-4cce-bc92-4a23b3b1f974_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36788,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/f6c9fac3-dcd3-4843-9ac0-c098ddfde58f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35396,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/29b57fa6-1b20-419e-b73a-533d81dd49c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45868,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/2339fa94-9160-4413-ac95-386d9f5e0641_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/64df1d19-4745-4226-a6ec-d1292c4e84fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56482,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/625bb682-2935-4c09-b5ce-5257465711f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47989,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/da10f928-dcfe-476b-8559-4c96f6db7ed1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43508,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/c7a02eb4-6786-482c-8ee6-892865d17599_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb63f65-cf7c-580d-92a3-f87cf091f797/cbb63f65-cf7c-580d-92a3-f87cf091f797_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60958,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA74XYV/2025-11-25/image/35cdc5f2-91d8-4904-8dcc-b54d9f358746_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-30',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Trophy 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Trophy 5dr DCT',
 'vin': None,
 'year': 2025}
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429220%27 HTTP/1.1" 200 None
2025-12-03 19:05:40 [astonbarclay.gb] INFO: Saving data for 117429220: {'created_time': 1764788740.694795, 'last_price_update_time': 1764788740.694806, 'auction_closing_time': 1765792800.0}
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117429220') HTTP/1.1" 204 0
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/bc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117724459?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/f2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec33790>
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cafe610>
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7fe550>
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee65250>
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1dfd0>
2025-12-03 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee67390>
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fbc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/bc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba3a90>
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118edd34d0>
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee65b50>
2025-12-03 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPJ66EOP%252F2025-12-03%252Fimage%252F0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08
2025-12-03 19:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7062b5c-ae93-5012-8a5f-6ee8800b2a08, skipping ID generation
2025-12-03 19:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08 with scrape type 1
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7062b5c-ae93-5012-8a5f-6ee8800b2a08 from tracking dictionaries
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7062b5c-ae93-5012-8a5f-6ee8800b2a08 sending to next pipeline
2025-12-03 19:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a7062b5c-ae93-5012-8a5f-6ee8800b2a08, identifier: 117724459
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f828250>
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Ff2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/f2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1c090>
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252F3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/e33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/df6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/f35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679523?view=catalogue)
2025-12-03 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a7062b5c-ae93-5012-8a5f-6ee8800b2a08 with identifier: 117724459
2025-12-03 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a7062b5c-ae93-5012-8a5f-6ee8800b2a08 with identifier: 117724459
2025-12-03 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163516 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163516
2025-12-03 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a7062b5c-ae93-5012-8a5f-6ee8800b2a08 spider: astonbarclay.gb
2025-12-03 19:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a7062b5c-ae93-5012-8a5f-6ee8800b2a08 due to rule: high_mileage_for_country.json, error: 163516 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163516
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a7062b5c-ae93-5012-8a5f-6ee8800b2a08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PJ66EOP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117724459',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 101605,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39299,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/43c4961e-d4e8-4a7a-a189-db02c9fd2f84_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35914,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/40a99c63-93a1-45f6-8c86-371bc2886b20_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34344,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/2e16ed50-e9a6-4527-ac2e-d2b2439350b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35049,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/cfe12f59-5f42-4e23-9460-b555ba084c35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49413,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/7c5f2efd-fcea-4038-a0ee-a3f6036cbfb3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63104,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/980c4c09-bc5b-4dfb-83c0-17683a627523_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47660,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/0b080a43-0ba9-43e6-b62e-e61663233545_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60907,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/1bc29a90-7f07-463b-bf27-4bbdb48d22bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7062b5c-ae93-5012-8a5f-6ee8800b2a08/a7062b5c-ae93-5012-8a5f-6ee8800b2a08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PJ66EOP/2025-12-03/image/6c4284dd-f100-4c69-895f-1ed82e0fa6e7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-23',
 'seller_name': 'LDG',
 'title': 'FIAT 500 HATCHBACK 1.2 S 3dr',
 'transmission': 'manual',
 'trim': '1.2 S 3dr',
 'vin': None,
 'year': 2016}
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117724459%27 HTTP/1.1" 200 None
2025-12-03 19:05:43 [astonbarclay.gb] INFO: Saving data for 117724459: {'created_time': 1764788743.855839, 'last_price_update_time': 1764788743.855849, 'auction_closing_time': 1765285200.0}
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117724459') HTTP/1.1" 204 0
2025-12-03 19:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/da2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117644920?view=catalogue)
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eb88ed0>
2025-12-03 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_11.jpg HTTP/1.1" 201 0
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fe33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/e33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff51510>
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_10.jpg HTTP/1.1" 201 0
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252F2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f85c290>
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_12.jpg HTTP/1.1" 201 0
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fdf6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/df6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eca11d0>
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Ff35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/f35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f829390>
2025-12-03 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDK68NFD%252F2025-12-03%252Fimage%252Fba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a4c9d15-f349-598f-b5c8-4c228bf14146
2025-12-03 19:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a4c9d15-f349-598f-b5c8-4c228bf14146, skipping ID generation
2025-12-03 19:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a4c9d15-f349-598f-b5c8-4c228bf14146 with scrape type 1
2025-12-03 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4a4c9d15-f349-598f-b5c8-4c228bf14146 from tracking dictionaries
2025-12-03 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a4c9d15-f349-598f-b5c8-4c228bf14146 sending to next pipeline
2025-12-03 19:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a4c9d15-f349-598f-b5c8-4c228bf14146, identifier: 117679523
2025-12-03 19:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a4c9d15-f349-598f-b5c8-4c228bf14146 with identifier: 117679523
2025-12-03 19:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a4c9d15-f349-598f-b5c8-4c228bf14146 with identifier: 117679523
2025-12-03 19:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4a4c9d15-f349-598f-b5c8-4c228bf14146 with identifier: 117679523 to the API
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BEIGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4a4c9d15-f349-598f-b5c8-4c228bf14146',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DK68NFD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117679523',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 45303,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38692,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/ba2c530f-c0f7-4463-8cf4-ed4c0341558b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37037,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/9e9ff2db-0e72-42af-b13d-6212632873a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35279,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/358b47af-a11b-40ea-880b-10f54a0deb43_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35350,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/a8a24c71-3333-4065-8c1a-559448838a2b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44630,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/257826b9-e4ae-4bbf-9d7d-4da791028bb2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44651,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/8a709846-c8f8-44c6-8b4b-6a5bd664ef79_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45341,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/4b43f7ed-380d-4560-a0df-8d8d7e18d8af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47430,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/00067b81-0b80-4a68-96e5-cfb2312a2e01_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49091,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/bc612b62-5033-402a-8e72-22ef5f52ecfe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50970,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/f35c1cf4-2c13-4769-8918-3cbadc9e3703_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53590,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/2145ef5f-270a-4fd2-be69-17e6745aa7e9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51728,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/e33788cc-0f0b-4e1e-8325-36cee1988e37_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a4c9d15-f349-598f-b5c8-4c228bf14146/4a4c9d15-f349-598f-b5c8-4c228bf14146_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62763,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DK68NFD/2025-12-03/image/df6d28bf-2f20-434d-a69a-bb45490517d3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-26',
 'seller_name': 'Vantage Motor Group',
 'title': 'BMW 2 SERIES ACTIVE TOURER 220i SE 5dr DCT',
 'transmission': 'automatic',
 'trim': '220i SE 5dr DCT',
 'vin': None,
 'year': 2018}
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679523%27 HTTP/1.1" 200 None
2025-12-03 19:05:45 [astonbarclay.gb] INFO: Saving data for 117679523: {'created_time': 1764788745.728731, 'last_price_update_time': 1764788745.728742, 'auction_closing_time': 1765285200.0}
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117679523') HTTP/1.1" 204 0
2025-12-03 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516725?view=catalogue)
2025-12-03 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681445?view=catalogue)
2025-12-03 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/f7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117434122?view=catalogue)
2025-12-03 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117358574?view=catalogue)
2025-12-03 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117699816?view=catalogue)
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118e9e33d0>
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_9.jpg HTTP/1.1" 201 0
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Fda2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/da2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cafed90>
2025-12-03 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebd0e10>
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_8.jpg HTTP/1.1" 201 0
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNV67CZN%252F2025-12-03%252Fimage%252Fb0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c0427c3-9123-5d2d-af01-56c3912aa066
2025-12-03 19:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c0427c3-9123-5d2d-af01-56c3912aa066, skipping ID generation
2025-12-03 19:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c0427c3-9123-5d2d-af01-56c3912aa066 with scrape type 1
2025-12-03 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c0427c3-9123-5d2d-af01-56c3912aa066 from tracking dictionaries
2025-12-03 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c0427c3-9123-5d2d-af01-56c3912aa066 sending to next pipeline
2025-12-03 19:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4c0427c3-9123-5d2d-af01-56c3912aa066, identifier: 117644920
2025-12-03 19:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4c0427c3-9123-5d2d-af01-56c3912aa066 with identifier: 117644920
2025-12-03 19:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4c0427c3-9123-5d2d-af01-56c3912aa066 with identifier: 117644920
2025-12-03 19:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4c0427c3-9123-5d2d-af01-56c3912aa066 with identifier: 117644920 to the API
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4c0427c3-9123-5d2d-af01-56c3912aa066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NV67CZN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117644920',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'AYGO HATCHBACK',
 'odometer': 54953,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28448,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/5495da9f-90c8-4e4f-817a-3bf1efbbb175_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28476,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/6adf2e3f-2b31-4321-9f4d-961d546a3bf2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28957,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b4ff14b5-e518-466f-8cfe-e96dbdaab431_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28474,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ecbd5aa0-254e-494b-97ae-67df76927d99_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49851,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/4cd170f7-a9ce-4240-8c4a-a8711191ecbd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60679,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/f2002e12-2c45-470a-86b4-359f427cc924_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41271,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/3e79f6ec-7114-4403-9613-0de288049dbd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47138,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/ca7b9081-ced4-4185-a17b-7c178b4fc767_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c0427c3-9123-5d2d-af01-56c3912aa066/4c0427c3-9123-5d2d-af01-56c3912aa066_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50051,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NV67CZN/2025-12-03/image/b0391cea-c258-4941-a04d-6dc2c753b561_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-12',
 'seller_name': 'Vantage Motor Group',
 'title': 'TOYOTA AYGO HATCHBACK 1.0 VVT-i X-Press 5dr',
 'transmission': 'manual',
 'trim': '1.0 VVT-i X-Press 5dr',
 'vin': None,
 'year': 2018}
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117644920%27 HTTP/1.1" 200 None
2025-12-03 19:05:46 [astonbarclay.gb] INFO: Saving data for 117644920: {'created_time': 1764788746.915963, 'last_price_update_time': 1764788746.915975, 'auction_closing_time': 1765285200.0}
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117644920') HTTP/1.1" 204 0
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed23350>
2025-12-03 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72KZL%252F2025-12-02%252Fimage%252F2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e55c7b69-73dd-55bd-b72b-a672b0b4c576
2025-12-03 19:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e55c7b69-73dd-55bd-b72b-a672b0b4c576, skipping ID generation
2025-12-03 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55c7b69-73dd-55bd-b72b-a672b0b4c576 with scrape type 1
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e55c7b69-73dd-55bd-b72b-a672b0b4c576 from tracking dictionaries
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e55c7b69-73dd-55bd-b72b-a672b0b4c576 sending to next pipeline
2025-12-03 19:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e55c7b69-73dd-55bd-b72b-a672b0b4c576, identifier: 117516725
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f119cadf810>
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA22CXR%252F2025-12-03%252Fimage%252Fde6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a60fbc7c-8d07-5df6-8852-594e54aa5289
2025-12-03 19:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a60fbc7c-8d07-5df6-8852-594e54aa5289, skipping ID generation
2025-12-03 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a60fbc7c-8d07-5df6-8852-594e54aa5289 with scrape type 1
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a60fbc7c-8d07-5df6-8852-594e54aa5289 from tracking dictionaries
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a60fbc7c-8d07-5df6-8852-594e54aa5289 sending to next pipeline
2025-12-03 19:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a60fbc7c-8d07-5df6-8852-594e54aa5289, identifier: 117681445
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ea95a90>
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252Ff7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/f7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f7b3cd0>
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG24WCK%252F2025-11-24%252Fimage%252F0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bff6390-5aac-5108-95cb-36a7926e3ccb
2025-12-03 19:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bff6390-5aac-5108-95cb-36a7926e3ccb, skipping ID generation
2025-12-03 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bff6390-5aac-5108-95cb-36a7926e3ccb with scrape type 1
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2bff6390-5aac-5108-95cb-36a7926e3ccb from tracking dictionaries
2025-12-03 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bff6390-5aac-5108-95cb-36a7926e3ccb sending to next pipeline
2025-12-03 19:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2bff6390-5aac-5108-95cb-36a7926e3ccb, identifier: 117434122
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ff52710>
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO24NUP%252F2025-11-20%252Fimage%252Fead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1224a4a-fc3e-54a9-8bca-355b5b035776
2025-12-03 19:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1224a4a-fc3e-54a9-8bca-355b5b035776, skipping ID generation
2025-12-03 19:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1224a4a-fc3e-54a9-8bca-355b5b035776 with scrape type 1
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1224a4a-fc3e-54a9-8bca-355b5b035776 from tracking dictionaries
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1224a4a-fc3e-54a9-8bca-355b5b035776 sending to next pipeline
2025-12-03 19:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1224a4a-fc3e-54a9-8bca-355b5b035776, identifier: 117358574
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee68850>
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX69DKJ%252F2025-12-03%252Fimage%252Fbc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 220e044f-9488-53a3-abe3-082bdc9668e8
2025-12-03 19:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 220e044f-9488-53a3-abe3-082bdc9668e8, skipping ID generation
2025-12-03 19:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220e044f-9488-53a3-abe3-082bdc9668e8 with scrape type 1
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 220e044f-9488-53a3-abe3-082bdc9668e8 from tracking dictionaries
2025-12-03 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 220e044f-9488-53a3-abe3-082bdc9668e8 sending to next pipeline
2025-12-03 19:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 220e044f-9488-53a3-abe3-082bdc9668e8, identifier: 117699816
2025-12-03 19:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e55c7b69-73dd-55bd-b72b-a672b0b4c576 with identifier: 117516725
2025-12-03 19:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e55c7b69-73dd-55bd-b72b-a672b0b4c576 with identifier: 117516725
2025-12-03 19:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'hyundai ioniq 5 electric hatchback 160kw ultimate 73 kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq 5 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33629, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516725', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '160kw ultimate 73 kwh 5dr auto', 'license_plate': 'dv72kzl', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e55c7b69-73dd-55bd-b72b-a672b0b4c576', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28825}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28944}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41292}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56134}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'hyundai ioniq 5 electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 54120} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'e55c7b69-73dd-55bd-b72b-a672b0b4c576',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dv72kzl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516725',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq 5 electric hatchback',
     'model': 'ioniq 5 electric hatchback',
     'odometer': 33629,
     'odometer_in_km': 54120,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28825,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28366,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28944,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29561,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41292,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48581,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52035,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56134,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-28',
     'sanitized_make': 'hyundai',
     'seller_name': 'zenith',
     'title': 'hyundai ioniq 5 electric hatchback 160kw ultimate 73 kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '160kw ultimate 73 kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-03 19:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: e55c7b69-73dd-55bd-b72b-a672b0b4c576 spider: astonbarclay.gb
2025-12-03 19:05:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e55c7b69-73dd-55bd-b72b-a672b0b4c576 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'hyundai ioniq 5 electric hatchback 160kw ultimate 73 kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq 5 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33629, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516725', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '160kw ultimate 73 kwh 5dr auto', 'license_plate': 'dv72kzl', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e55c7b69-73dd-55bd-b72b-a672b0b4c576', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28825}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28944}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41292}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56134}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'hyundai ioniq 5 electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 54120} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'e55c7b69-73dd-55bd-b72b-a672b0b4c576',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dv72kzl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516725',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq 5 electric hatchback',
     'model': 'ioniq 5 electric hatchback',
     'odometer': 33629,
     'odometer_in_km': 54120,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28825,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28366,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28944,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29561,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41292,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48581,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52035,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56134,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-28',
     'sanitized_make': 'hyundai',
     'seller_name': 'zenith',
     'title': 'hyundai ioniq 5 electric hatchback 160kw ultimate 73 kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '160kw ultimate 73 kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'e55c7b69-73dd-55bd-b72b-a672b0b4c576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV72KZL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516725',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'IONIQ 5 ELECTRIC HATCHBACK',
 'odometer': 33629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28825,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/2ea3a2cc-2eb9-4f6d-afa8-84b158bb55a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28366,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/8dd1d257-3167-4284-9ba7-3e0268b4fc9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28944,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/c68889e8-f580-4916-9458-cdf3ff92cb5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29561,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fa38bdb1-924e-4390-b000-15aa6fb0c116_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41292,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/691e0a15-b082-4f70-a73e-219619bb7685_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48581,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/a4f2584a-93d7-4431-8445-f0bc1e08856c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52035,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/fcad75a6-9183-46ed-91d9-8c1f7e20e2e9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55c7b69-73dd-55bd-b72b-a672b0b4c576/e55c7b69-73dd-55bd-b72b-a672b0b4c576_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56134,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72KZL/2025-12-02/image/4a53666e-9bf7-499b-807e-eec0f3aa792a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI IONIQ 5 ELECTRIC HATCHBACK 160kW Ultimate 73 kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW Ultimate 73 kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516725%27 HTTP/1.1" 200 None
2025-12-03 19:05:48 [astonbarclay.gb] INFO: Saving data for 117516725: {'created_time': 1764788748.933897, 'last_price_update_time': 1764788748.933911, 'auction_closing_time': 1764842400.0}
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117516725') HTTP/1.1" 204 0
2025-12-03 19:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a60fbc7c-8d07-5df6-8852-594e54aa5289 with identifier: 117681445
2025-12-03 19:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a60fbc7c-8d07-5df6-8852-594e54aa5289 with identifier: 117681445
2025-12-03 19:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a60fbc7c-8d07-5df6-8852-594e54aa5289 with identifier: 117681445 to the API
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a60fbc7c-8d07-5df6-8852-594e54aa5289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LA22CXR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681445',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 26493,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39387,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/feeeec64-8d74-4555-be15-fd0b7b9bca32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45631,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a35ed9de-b938-4203-9cd4-3cc689c86f4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44349,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a5005270-1321-4b4c-916f-617d553b98fc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/174abce7-d624-415d-95da-3a31a6b05350_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51442,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/de6c34aa-131e-4497-9b26-00bd454c2d81_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50156,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/99ebb60b-4b0f-455f-a697-9afea7588836_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53958,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/a18f0a64-0df5-4c1a-9113-6d248ed852c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39678,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/c3698eb4-a717-483e-827d-bdd96c536d32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56854,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/1c34f2e3-d639-46f7-b144-4aa422eda90a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60fbc7c-8d07-5df6-8852-594e54aa5289/a60fbc7c-8d07-5df6-8852-594e54aa5289_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65737,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA22CXR/2025-12-03/image/d7225058-dbd6-4735-8b8b-2f629beb2a00_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-15',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 180 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 180 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681445%27 HTTP/1.1" 200 None
2025-12-03 19:05:49 [astonbarclay.gb] INFO: Saving data for 117681445: {'created_time': 1764788749.29477, 'last_price_update_time': 1764788749.294781, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681445') HTTP/1.1" 204 0
2025-12-03 19:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2bff6390-5aac-5108-95cb-36a7926e3ccb with identifier: 117434122
2025-12-03 19:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2bff6390-5aac-5108-95cb-36a7926e3ccb with identifier: 117434122
2025-12-03 19:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2bff6390-5aac-5108-95cb-36a7926e3ccb with identifier: 117434122 to the API
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2bff6390-5aac-5108-95cb-36a7926e3ccb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LG24WCK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117434122',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 19870,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39292,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/24953ead-4618-4d0e-8747-551d7a62f716_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37311,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/1f2829b1-251b-4f23-b958-16a7fa7819f0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33575,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/17ac9763-fda5-472a-b5f1-06f705f081e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37455,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/0de13c54-7f37-4c76-a871-d9aafd12fd0b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46837,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/c2554ad1-42a9-4ff3-9f04-733efa5a9817_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44852,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/291e5870-2e5e-4f39-8908-806309d89b07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40778,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/f7ee1086-38c3-44cc-9e8d-7cb2f3cf920a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51504,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/fa1597a0-36c2-4159-99d8-9b0653505834_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35254,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/6f60cc6b-de90-4e5b-90b0-b2d222cbea3a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48671,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/da2c1e60-5c37-4d56-a08c-f548a641a2dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bff6390-5aac-5108-95cb-36a7926e3ccb/2bff6390-5aac-5108-95cb-36a7926e3ccb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37165,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG24WCK/2025-11-24/image/2cedfb7c-d126-4c42-a361-17cbd3d73410_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-21',
 'seller_name': 'Motability Operations',
 'title': 'BMW 2 SERIES GRAN COUPE 218i [136] M Sport 4dr DCT',
 'transmission': 'automatic',
 'trim': '218i [136] M Sport 4dr DCT',
 'vin': None,
 'year': 2024}
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117434122%27 HTTP/1.1" 200 None
2025-12-03 19:05:49 [astonbarclay.gb] INFO: Saving data for 117434122: {'created_time': 1764788749.661017, 'last_price_update_time': 1764788749.661026, 'auction_closing_time': 1765792800.0}
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117434122') HTTP/1.1" 204 0
2025-12-03 19:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1224a4a-fc3e-54a9-8bca-355b5b035776 with identifier: 117358574
2025-12-03 19:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1224a4a-fc3e-54a9-8bca-355b5b035776 with identifier: 117358574
2025-12-03 19:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1224a4a-fc3e-54a9-8bca-355b5b035776 with identifier: 117358574 to the API
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a1224a4a-fc3e-54a9-8bca-355b5b035776',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO24NUP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117358574',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 10260,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/dd6ed32a-d53e-4c41-8b9d-02c63a7d63d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44094,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/3a33cb6b-9f6e-48df-b2f4-6def1392d7c1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37667,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/9c1ebeae-d7d8-45da-a99f-92b8b0686bed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41858,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/38b58b4e-acec-4c15-82b8-0bf48c28801f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58357,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/a7052159-b299-43ae-8b6f-0afccf74dbcf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46636,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/5f1b22c8-989d-4b4b-8045-037d6561fd7e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52630,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/ead12246-4901-44a9-bcab-a6a17d4b88e1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1224a4a-fc3e-54a9-8bca-355b5b035776/a1224a4a-fc3e-54a9-8bca-355b5b035776_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37521,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO24NUP/2025-11-20/image/47fdcaa8-5fe5-4b02-9ea2-dc3b5a24edb7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-03',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 130 GT 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 GT 5dr EAT8',
 'vin': None,
 'year': 2024}
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117358574%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Saving data for 117358574: {'created_time': 1764788750.01545, 'last_price_update_time': 1764788750.015459, 'auction_closing_time': 1765792800.0}
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117358574') HTTP/1.1" 204 0
2025-12-03 19:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 220e044f-9488-53a3-abe3-082bdc9668e8 with identifier: 117699816
2025-12-03 19:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 220e044f-9488-53a3-abe3-082bdc9668e8 with identifier: 117699816
2025-12-03 19:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 220e044f-9488-53a3-abe3-082bdc9668e8 with identifier: 117699816 to the API
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '220e044f-9488-53a3-abe3-082bdc9668e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX69DKJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117699816',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LEXUS',
 'model': 'NX ESTATE',
 'odometer': 24935,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26137,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/4a0ac74d-f60d-4c24-a9ac-83059627f6df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25722,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/89d7b3ae-ed7b-4d0b-ac95-bcc38e25e34d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25888,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/d4e1a586-578e-4de4-aa6d-2f64d84e9df6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23192,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/6f22caf4-cb85-4af3-b426-e478aabd42e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46062,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/1d0d03d1-caf3-4f4c-867e-3166ae20992d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84177,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/036ce3e6-30d0-417e-8ae2-cd56387d89a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80914,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/bc7ae436-b177-4678-87c7-20e75ad8d40d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58975,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/358b2294-32bd-4be3-8c58-b2d9a5dcd924_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3512,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/23396a01-a0a1-4b09-afb6-d950c5c62951_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220e044f-9488-53a3-abe3-082bdc9668e8/220e044f-9488-53a3-abe3-082bdc9668e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44746,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EX69DKJ/2025-12-03/image/10189511-e150-4e40-a349-c16aba095782_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-07',
 'seller_name': 'UKCGR - Premium',
 'title': 'LEXUS NX ESTATE 300h 2.5 F-Sport 5dr CVT [Premium Pack/Leather]',
 'transmission': 'automatic',
 'trim': '300h 2.5 F-Sport 5dr CVT [Premium Pack/Leather]',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699816%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Saving data for 117699816: {'created_time': 1764788750.491134, 'last_price_update_time': 1764788750.491145, 'auction_closing_time': 1765360800.0}
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117699816') HTTP/1.1" 204 0
2025-12-03 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117076340?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116988272?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117195848, 'registration': 'DV72NXU', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr', 'mileage': 30431, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 274, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-10-17', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72NXU/2025-11-24/image/1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/edf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/a18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/25-26k,', 'remarks': 'VOSA STATES 30K, spare key', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b0c1c700-592d-4819-99f5-28936c548b74.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117195848, 'registration': 'DV72NXU', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr', 'mileage': 30431, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 274, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-10-17', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV72NXU/2025-11-24/image/1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/edf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/a18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/25-26k,', 'remarks': 'VOSA STATES 30K, spare key', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b0c1c700-592d-4819-99f5-28936c548b74.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3348f33-f3a9-5a50-b139-39e4d4a9b9ff with identifier: 117195848
2025-12-03 19:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff with scrape type 1
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117076340, 'registration': 'BD73HAE', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta 5dr Auto', 'mileage': 14249, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 275, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD73HAE/2025-11-18/image/1dce8fd3-2266-4015-8a0d-07bc1df91a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/8c8a2229-86cf-48d0-91cd-a7894822b48a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/f49f3d12-d89f-407c-98c7-4d090d1246c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/c73c3720-c7f6-4e14-a9c1-79bdb0865f10_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/23d3a753-256e-49f4-81f5-d42ea7b9ccf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/53256cde-9678-470a-adfa-e4e13d44de72_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/97c8b5ae-1a0c-4dc3-a65e-09b12aa06b6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/63545d02-30b9-4a54-ba13-832fe3f8ccf6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca918c93-8cd5-46e3-be66-81196b6cbcdf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117076340, 'registration': 'BD73HAE', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power N-Connecta 5dr Auto', 'mileage': 14249, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 275, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD73HAE/2025-11-18/image/1dce8fd3-2266-4015-8a0d-07bc1df91a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/8c8a2229-86cf-48d0-91cd-a7894822b48a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/f49f3d12-d89f-407c-98c7-4d090d1246c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/c73c3720-c7f6-4e14-a9c1-79bdb0865f10_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/23d3a753-256e-49f4-81f5-d42ea7b9ccf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/53256cde-9678-470a-adfa-e4e13d44de72_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/97c8b5ae-1a0c-4dc3-a65e-09b12aa06b6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/63545d02-30b9-4a54-ba13-832fe3f8ccf6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book BLANK BOOK', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca918c93-8cd5-46e3-be66-81196b6cbcdf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-03 19:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53102374-76b7-5b6f-bea9-91d291ba1c86 with identifier: 117076340
2025-12-03 19:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53102374-76b7-5b6f-bea9-91d291ba1c86 with scrape type 1
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 53102374-76b7-5b6f-bea9-91d291ba1c86
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252F1dce8fd3-2266-4015-8a0d-07bc1df91a95_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/1dce8fd3-2266-4015-8a0d-07bc1df91a95_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252F8c8a2229-86cf-48d0-91cd-a7894822b48a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/8c8a2229-86cf-48d0-91cd-a7894822b48a_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252Ff49f3d12-d89f-407c-98c7-4d090d1246c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/f49f3d12-d89f-407c-98c7-4d090d1246c1_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252Fc73c3720-c7f6-4e14-a9c1-79bdb0865f10_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/c73c3720-c7f6-4e14-a9c1-79bdb0865f10_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252F23d3a753-256e-49f4-81f5-d42ea7b9ccf8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/23d3a753-256e-49f4-81f5-d42ea7b9ccf8_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252F53256cde-9678-470a-adfa-e4e13d44de72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/53256cde-9678-470a-adfa-e4e13d44de72_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252F97c8b5ae-1a0c-4dc3-a65e-09b12aa06b6a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/97c8b5ae-1a0c-4dc3-a65e-09b12aa06b6a_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD73HAE%252F2025-11-18%252Fimage%252F63545d02-30b9-4a54-ba13-832fe3f8ccf6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD73HAE/2025-11-18/image/63545d02-30b9-4a54-ba13-832fe3f8ccf6_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 53102374-76b7-5b6f-bea9-91d291ba1c86, identifier: 117076340
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116988272, 'registration': 'BV69FJA', 'account': 'RCI002', 'make': 'RENAULT', 'model': 'GRAND SCENIC ESTATE', 'derivative': '1.3 TCE 140 Signature 5dr', 'mileage': 14431, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 273, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2024-10-30', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BV69FJA/2025-11-11/image/ef9add8a-320b-4a37-8418-75c41f1d6abc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/b7f21a18-57c7-45f2-92db-a242e710c1cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/37fa5397-e9b9-4a4c-96a0-d587cf7275b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/307626f7-d968-4d60-a648-51ba1da6818b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/de1aa22c-676d-435c-b37d-adf9ecb123ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/1d51a238-2d34-417f-9ede-e2b87ae0c704_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/5c27fb06-33f3-46e2-8724-2f009b7a6c8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/e793009b-0019-4545-a51d-83f98db85619_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20-3K, 11/21-6K, 10/22-8K, 10/23-11K, 02/25-13K,', 'remarks': 'VOSA STATES 8K, 11K,', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc9e8cf5-208a-438e-ab26-e5286f8a6f4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:05:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116988272, 'registration': 'BV69FJA', 'account': 'RCI002', 'make': 'RENAULT', 'model': 'GRAND SCENIC ESTATE', 'derivative': '1.3 TCE 140 Signature 5dr', 'mileage': 14431, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 230}, 'saleStart': '2025-12-04T10:00Z', 'lot': 273, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2024-10-30', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BV69FJA/2025-11-11/image/ef9add8a-320b-4a37-8418-75c41f1d6abc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/b7f21a18-57c7-45f2-92db-a242e710c1cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/37fa5397-e9b9-4a4c-96a0-d587cf7275b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/307626f7-d968-4d60-a648-51ba1da6818b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/de1aa22c-676d-435c-b37d-adf9ecb123ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/1d51a238-2d34-417f-9ede-e2b87ae0c704_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/5c27fb06-33f3-46e2-8724-2f009b7a6c8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/e793009b-0019-4545-a51d-83f98db85619_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20-3K, 11/21-6K, 10/22-8K, 10/23-11K, 02/25-13K,', 'remarks': 'VOSA STATES 8K, 11K,', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc9e8cf5-208a-438e-ab26-e5286f8a6f4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-03 19:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0ccdee-2224-5b19-918c-0535e459df0b with identifier: 116988272
2025-12-03 19:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0ccdee-2224-5b19-918c-0535e459df0b with scrape type 1
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3b0ccdee-2224-5b19-918c-0535e459df0b
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252Fef9add8a-320b-4a37-8418-75c41f1d6abc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/ef9add8a-320b-4a37-8418-75c41f1d6abc_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252Fb7f21a18-57c7-45f2-92db-a242e710c1cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/b7f21a18-57c7-45f2-92db-a242e710c1cd_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252F37fa5397-e9b9-4a4c-96a0-d587cf7275b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/37fa5397-e9b9-4a4c-96a0-d587cf7275b2_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252F307626f7-d968-4d60-a648-51ba1da6818b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/307626f7-d968-4d60-a648-51ba1da6818b_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252Fde1aa22c-676d-435c-b37d-adf9ecb123ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/de1aa22c-676d-435c-b37d-adf9ecb123ad_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252F1d51a238-2d34-417f-9ede-e2b87ae0c704_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/1d51a238-2d34-417f-9ede-e2b87ae0c704_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252F5c27fb06-33f3-46e2-8724-2f009b7a6c8b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/5c27fb06-33f3-46e2-8724-2f009b7a6c8b_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV69FJA%252F2025-11-11%252Fimage%252Fe793009b-0019-4545-a51d-83f98db85619_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV69FJA/2025-11-11/image/e793009b-0019-4545-a51d-83f98db85619_removebg.jpg?w=600 already downloaded
2025-12-03 19:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3b0ccdee-2224-5b19-918c-0535e459df0b, identifier: 116988272
2025-12-03 19:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 53102374-76b7-5b6f-bea9-91d291ba1c86 with identifier: 117076340
2025-12-03 19:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 53102374-76b7-5b6f-bea9-91d291ba1c86 with identifier: 117076340
2025-12-03 19:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 53102374-76b7-5b6f-bea9-91d291ba1c86 with identifier: 117076340 to the API
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117076340?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '53102374-76b7-5b6f-bea9-91d291ba1c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BD73HAE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117076340',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 14249,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BD73HAE/2025-11-18/image/1dce8fd3-2266-4015-8a0d-07bc1df91a95_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/8c8a2229-86cf-48d0-91cd-a7894822b48a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/f49f3d12-d89f-407c-98c7-4d090d1246c1_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/c73c3720-c7f6-4e14-a9c1-79bdb0865f10_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/23d3a753-256e-49f4-81f5-d42ea7b9ccf8_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/53256cde-9678-470a-adfa-e4e13d44de72_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/97c8b5ae-1a0c-4dc3-a65e-09b12aa06b6a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/63545d02-30b9-4a54-ba13-832fe3f8ccf6_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33914,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/1dce8fd3-2266-4015-8a0d-07bc1df91a95_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33164,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/8c8a2229-86cf-48d0-91cd-a7894822b48a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31302,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/f49f3d12-d89f-407c-98c7-4d090d1246c1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30217,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/c73c3720-c7f6-4e14-a9c1-79bdb0865f10_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52826,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/23d3a753-256e-49f4-81f5-d42ea7b9ccf8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56147,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/53256cde-9678-470a-adfa-e4e13d44de72_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64702,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/97c8b5ae-1a0c-4dc3-a65e-09b12aa06b6a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53102374-76b7-5b6f-bea9-91d291ba1c86/53102374-76b7-5b6f-bea9-91d291ba1c86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59301,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD73HAE/2025-11-18/image/63545d02-30b9-4a54-ba13-832fe3f8ccf6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power N-Connecta 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power N-Connecta 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117076340%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [astonbarclay.gb] INFO: Saving data for 117076340: {'created_time': 1764788751.409883, 'last_price_update_time': 1764788751.409893, 'auction_closing_time': 1764842400.0}
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117076340') HTTP/1.1" 204 0
2025-12-03 19:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3b0ccdee-2224-5b19-918c-0535e459df0b with identifier: 116988272
2025-12-03 19:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3b0ccdee-2224-5b19-918c-0535e459df0b with identifier: 116988272
2025-12-03 19:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3b0ccdee-2224-5b19-918c-0535e459df0b with identifier: 116988272 to the API
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116988272?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3b0ccdee-2224-5b19-918c-0535e459df0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BV69FJA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988272',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'RENAULT',
 'model': 'GRAND SCENIC ESTATE',
 'odometer': 14431,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photo_urls': ['https://abimg003.imgix.net/BV69FJA/2025-11-11/image/ef9add8a-320b-4a37-8418-75c41f1d6abc_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/b7f21a18-57c7-45f2-92db-a242e710c1cd_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/37fa5397-e9b9-4a4c-96a0-d587cf7275b2_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/307626f7-d968-4d60-a648-51ba1da6818b_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/de1aa22c-676d-435c-b37d-adf9ecb123ad_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/1d51a238-2d34-417f-9ede-e2b87ae0c704_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/5c27fb06-33f3-46e2-8724-2f009b7a6c8b_removebg.jpg?w=600',
                'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/e793009b-0019-4545-a51d-83f98db85619_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32810,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/ef9add8a-320b-4a37-8418-75c41f1d6abc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33033,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/b7f21a18-57c7-45f2-92db-a242e710c1cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28325,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/37fa5397-e9b9-4a4c-96a0-d587cf7275b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29549,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/307626f7-d968-4d60-a648-51ba1da6818b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59016,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/de1aa22c-676d-435c-b37d-adf9ecb123ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68365,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/1d51a238-2d34-417f-9ede-e2b87ae0c704_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65150,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/5c27fb06-33f3-46e2-8724-2f009b7a6c8b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0ccdee-2224-5b19-918c-0535e459df0b/3b0ccdee-2224-5b19-918c-0535e459df0b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70242,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV69FJA/2025-11-11/image/e793009b-0019-4545-a51d-83f98db85619_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': 'Mobilize Financial Services',
 'title': 'RENAULT GRAND SCENIC ESTATE 1.3 TCE 140 Signature 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 Signature 5dr',
 'vin': None,
 'year': 2019}
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988272%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [astonbarclay.gb] INFO: Saving data for 116988272: {'created_time': 1764788751.724772, 'last_price_update_time': 1764788751.724783, 'auction_closing_time': 1764842400.0}
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116988272') HTTP/1.1" 204 0
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252Fedf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/edf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252Fa18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/a18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252Fadaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-03 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600 not downloaded yet
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/a18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/edf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117195848?view=catalogue)
2025-12-03 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ed58c90>
2025-12-03 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_0.jpg HTTP/1.1" 201 0
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eab44d0>
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_1.jpg HTTP/1.1" 201 0
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118eba8250>
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_2.jpg HTTP/1.1" 201 0
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec24210>
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_3.jpg HTTP/1.1" 201 0
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118f75acd0>
2025-12-03 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_5.jpg HTTP/1.1" 201 0
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252Fa18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/a18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ebab5d0>
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_4.jpg HTTP/1.1" 201 0
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252Fedf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/edf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ee1d010>
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_6.jpg HTTP/1.1" 201 0
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252F75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f118ec24590>
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_7.jpg HTTP/1.1" 201 0
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV72NXU%252F2025-11-24%252Fimage%252Fadaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600 saved to cache
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff
2025-12-03 19:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3348f33-f3a9-5a50-b139-39e4d4a9b9ff, skipping ID generation
2025-12-03 19:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff with scrape type 1
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff from tracking dictionaries
2025-12-03 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3348f33-f3a9-5a50-b139-39e4d4a9b9ff sending to next pipeline
2025-12-03 19:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e3348f33-f3a9-5a50-b139-39e4d4a9b9ff, identifier: 117195848
2025-12-03 19:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e3348f33-f3a9-5a50-b139-39e4d4a9b9ff with identifier: 117195848
2025-12-03 19:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e3348f33-f3a9-5a50-b139-39e4d4a9b9ff with identifier: 117195848
2025-12-03 19:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e3348f33-f3a9-5a50-b139-39e4d4a9b9ff with identifier: 117195848 to the API
2025-12-03 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 19:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': 'e3348f33-f3a9-5a50-b139-39e4d4a9b9ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV72NXU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117195848',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 30431,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31284,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/1e090f3d-7607-4063-919c-b243dbe27e02_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30578,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/04ba1037-0ab0-418f-b8fe-9980ec2931cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31138,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/9295241f-e25a-4aa9-bfb3-d09d772afb73_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31563,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/73faa6c3-18b8-4815-a1b6-8a5ce27606a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53235,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/edf37abf-5842-4558-b557-87f0ddc403cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57883,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/a18dacfa-85d9-4a67-9f44-69436d8fc44d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45858,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/75e749dc-302a-409b-bcdb-94ac50e771ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3348f33-f3a9-5a50-b139-39e4d4a9b9ff/e3348f33-f3a9-5a50-b139-39e4d4a9b9ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59516,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV72NXU/2025-11-24/image/adaba741-1dad-43b3-9d81-357c44236be1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
 'vin': None,
 'year': 2022}
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195848%27 HTTP/1.1" 200 None
2025-12-03 19:05:54 [astonbarclay.gb] INFO: Saving data for 117195848: {'created_time': 1764788754.22874, 'last_price_update_time': 1764788754.22875, 'auction_closing_time': 1764842400.0}
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195848') HTTP/1.1" 204 0
2025-12-03 19:05:54 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-03 19:05:54 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1}
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737879%27 HTTP/1.1" 200 None
2025-12-03 19:05:54 [astonbarclay.gb] INFO: Saving data for 117737879: {'created_time': 1764788754.388668}
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117737879') HTTP/1.1" 204 0
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201764356754 HTTP/1.1" 200 None
2025-12-03 19:05:54 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (139 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2025-12-03T19_00_00.jl
2025-12-03 19:05:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 530938,
 'downloader/request_count': 908,
 'downloader/request_method_count/GET': 908,
 'downloader/response_bytes': 34945521,
 'downloader/response_count': 908,
 'downloader/response_status_count/200': 908,
 'elapsed_time_seconds': 348.320237,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 3, 19, 5, 54, 516523, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 53,
 'item_dropped_reasons_count/DropItem': 53,
 'item_scraped_count': 139,
 'log_count/DEBUG': 11118,
 'log_count/ERROR': 49,
 'log_count/INFO': 10618,
 'memusage/max': 180305920,
 'memusage/startup': 127053824,
 'photo_download_count': 713,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 78,
 'playwright/request_count/aborted': 42,
 'playwright/request_count/method/GET': 55,
 'playwright/request_count/method/HEAD': 12,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 22,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 30,
 'playwright/request_count/resource_type/script': 7,
 'playwright/request_count/resource_type/stylesheet': 2,
 'playwright/request_count/resource_type/xhr': 13,
 'playwright/response_count': 36,
 'playwright/response_count/method/GET': 25,
 'playwright/response_count/method/POST': 11,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/script': 7,
 'playwright/response_count/resource_type/stylesheet': 2,
 'playwright/response_count/resource_type/xhr': 13,
 'request_depth_max': 3,
 'response_received_count': 195,
 'scheduler/dequeued': 908,
 'scheduler/dequeued/memory': 908,
 'scheduler/enqueued': 908,
 'scheduler/enqueued/memory': 908,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 194,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 7.910033190076258,
 'scrapy-zyte-api/mean_response_seconds': 7.912110635311675,
 'scrapy-zyte-api/processed': 194,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 194,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 193,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 194,
 'scrapy-zyte-api/request_args/httpResponseBody': 194,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 194,
 'scrapy-zyte-api/request_args/url': 194,
 'scrapy-zyte-api/status_codes/200': 194,
 'scrapy-zyte-api/success': 194,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 3, 19, 0, 6, 196286, tzinfo=datetime.timezone.utc)}
2025-12-03 19:05:54 [scrapy.core.engine] INFO: Spider closed (finished)